Maybe it doesn't really start shifting until the baby starts to become self aware.

That works. Kind of like how a human learns to talk by usually saying the word they hear the most around them.

So many good questions! I want Pullman to just write a history book about daemons. I don't really care about an actual story. I want more world building.