I think that going in the completely opposite direction of your comfort, "because life seems to be going that way," is totally the wrong answer. You're not being true to yourself in this one, you're just grabbing at straws because you're frustrated, afraid, and feeling out-of-control. I have done this, I've watched other people do it, and it never really ends well- it has not resulted in happiness, in either my experience, or in those that I observe.
So, my first thought is that you need to assess your working conditions. I've not had a "touching issue" when working any of my jobs, though some nonverbal use of contact has been done in order to let me know that someone is, for example, next to be, behind me, or under me when reaching into the safe. These kinds of contacts, for me, are fine because either of us may be speaking at the time, or otherwise occupied, and the easiest way to communicate is though touching. Sometimes, this can also be a "tap, tap" to say, "Please shift your hip away, you're blocking where I need to be." I'm also comfortable with this sort of contact.
However, being manhandled in a way that people would just move me around, would not be a comfortable sort of contact. Obviously, unwanted sexual contact is a complete no-no, but you know that already. In many cases, we are not often able to take pro-active action, and are only able to react to someone else's actions (such as touching us in ways we don't want).
So, What sorts of touching are you REALLY receiving? Where is your line drawn, what kinds of touching and from whom is okay? Are you feeling oversensitive to any kind of touching because of the previous issues you've had? Do you feel that you are frustrated with yourself, or with the actions of other people?
None of these things are bad things. If you're feeling oversensitive to any kind of touching, that is simply where you are right now. You've had bad experiences, you're scared or frustrated, you feel that there is danger... and your "line" is drawn much differently than other people's. It's not wrong, but being aware of it is important for your ability to communicate your needs.
If you're frustrated with yourself, perhaps recognizing what the problem is, and realizing that there are reasons for your sensitivity, and that you may have to be gentle and easy with yourself will help. And, perhaps you will endeavor to change your behavior, and take a stronger look at what's going on inside of you. Both of these options are fine, but they must be based in what you can do, and where you are in your journey.
My second thought is that you are in charge of your life- if things aren't working, you need to seek change! We, as humans, are adverse to change and it can be very difficult. It's similar to the problem of "Devil you know, devil you don't." When things change, or when we change things, we are moving toward the unknown, and that can be very uncomfortable and scary... but, sometimes it is necessary. We can adjust the change, we can set our intentions and move in directions we think would be best for us and for those around us.
It sounds like you're under a lot of stress for being a major breadwinner in your family, as well as a mother. Is there someone else in your life that may be able to help you with this? Are they already helping in a monetary sense, but could perhaps change some behaviors in order to help you outside of the money problem? Or, do you need to drop some things (or people) in your life that are dragging you down, making things harder? All of these changes can be hard, difficult to ask for or admit to yourself, but sometimes analyzing them and realizing your needs is the hardest step.
Also, you must be in charge of yourself in your workplace. It can be very easy to feel helpless, victimized, in places like that. I've never really found a job at the minimum-wage range that makes you feel empowered. They want to keep you, and everyone else, down as much as possible. It's manipulation, but you don't need to accept it. Your actions, and the interactions you have with other people, are yours to control and create. If people are touching you in ways you don't like, you need to be clear and forward with them and let them know they are overstepping your bounds.
Finally, I would also suggest counselling. It sounds like there may be some underlying stressors and problems that you're dealing with, and if you're feeling so frustrated, I would think that some extra help would be very useful to you. Talk to a doctor about it, or find some other avenues to get you some help- even temporary help can be extremely useful. I've had counselors change my life and my thinking in just one session.
Allowing yourself space and time to think, to look at how things are and how things aren't working for you, is really important. I keep a journal for this purpose, and I would highly recommend it to literally everyone in the world.
Good luck