What is your carb intake like? Are you drinking soda, chips, breads (even wheat), juice, desserts, potatoes, rice, high fructose corn syrup, etc...? I know there is a big focus on calories, but that doesn't work for everyone. That's why some of the most active people are STILL overweight.
The easiest way to lose weight is to control your insulin release (even in non-diabetic people). When you eat carbs, it makes you hold the weight. The carbs basically turn into sugar and your body grabs and holds it. When you eat protein, you lose the weight and don't hold it as fat.
So...my suggestion would be to make sure you are eating a lot of protein (80 grams if possible) and VERY little carbs...like maybe under 100 grams of carbs a day (this does not include veggies or fruits - those are free food and you should eat a ton of it as they are full of super good stuff for you!).
Contrary to what many believe, fats are good for you, though, they are not all created equal. Some fats are not good, but many fats that many people think are bad are proving to be a lot better for you than you may think! I know this will make most people gasp, but I eat butter, leave the fat in my organic beef, and even eat bacon... I believe nature gave me the food that my body was meant to eat and low fat is a silly diet. that's not natural. AND there is beginning to be proof that this is true.
I'm 5ft 4in and weight between 117 lbs - 130lbs (depending on how soon after I've had a baby). I'm prego with baby #5 and am not overweight at all. This type of eating does work. It gives me energy and strength for the day, as long as I eat fruits and veggies too. Those are important - not just eating protein.
But I highly suspect that you need to adjust your carb intake and you'll see a big improvement.
If you haven't already, I also highly suggest watching "Fat Head". You can instant watch it on Netflix. It's funny, informative, and a real eye opener. It'll explain much better than me about weight gain/loss, and it won't make you feel bad either! (it's not like Super Size Me)
Good luck!