Oh my no, you are certainly not alone.
Maturity in GTD comes when you recognize that you are the master of your lists; they work for you. They are not your master (or slave-driver, the way a lot of people treat them!).
I think one key to GTD at home is to recognize that there is a minimum level of done-ness that is required day-to-day. For me, that means dishes must be done; laundry must be done; food must be in the refrigerator; trash gets taken out on Mondays; pets and children must be cared for. This is a different comfort level for everyone. Some people are more neatnik than others. Decide on that minimum level, and work with your spouse/kids (if applicable) to establish a routine for that minimum level of done-ness that lets you feel at ease in your house.
Be aware of deadlines as far as bills to be paid, projects to be completed by a certain date, etc. That stuff goes on your calendar.
Beyond that, let your list go undone during the week. If you work long hours every weekday, then get to your minimum level of done-ness and then relax and have fun.
That means your action list remains untouched (though you should look at it once in a while, just to make sure you're not missing deadlines or priorities aren't changing). On weekends, you can power through that list. If you find a lot of items on your list aren't getting done for a long time, it means you either need to shift activities on your nights and weekends, you need to delegate/spend money and hire someone, or you need to put those items on the someday-maybe list.