I agree. They were terrible. It took forever to get through one, and if your weapon broke halfway in, you were screwed. And they were all so similar.
There's nothing like the Oblivion gates in Skyrim. The daedric princes each have their own quest (as always), but they don't play nearly as large a role as they have in previous games. You could easily avoid that stuff.
How do you feel about dragons, werewolves, and vampires? If those are acceptable for you, you'll be able to complete 95% of the content without any extra-dimensional beings or magic involved. Skyrim is also a lot more realistic than previous TES games in its combat mechanics and portrayal of medieval Scandinavian society. You can now get married, build a house, adopt children, chop wood or mine for extra money, etc. The potential for "realistic" gameplay is way higher in Skyrim than Oblivion.
Like greyhammer suggested above, you could RP a little to increase your enjoyment and immersion in the game. Create a Nord Warrior or Thief who refuses to use magic. Avoid the College of Winterhold (Mage's guild) and daedric quests. You'll still run into enemy mages from time to time, but as long as giants and dragons won't ruin your experience, you'll have a blast.