Adam and Eve had personal contacts with G-d and certainly worshipped Him.
What happened in the time of Adam's grandson Enosh is that people began
to treat created things (angels, heavenly bodies, etc.) as intermediaries
between them and G-d; that's what the Torah is referring to when it says
"Then [men] began to call [other things] by the Name of G-d"
Ask a follow-up question