To the Nth generation

According to Deuteronomy 24:

"Fathers shall not be put to death for their children, nor children put to death for their fathers; each is to die for his own sin."

I find it difficult to reconcile this with Exodus 20:5 which says:

You shall not bow down to them or worship them; for I, the Lord your God, am a jealous God, punishing the children for the sin of the fathers to the third and fourth generation of those who hate me.