While 1 serving of potatoes contains 80 calories, deep frying that portion quadruples the calories and adds 15 grams of fat to an otherwise fat-free food. Even a baked potato can be unhealthy if loads of cheese, sour cream, and bacon are added to it.