Infant baptism causes children to disbelieve they must be baptized by their own faith. Thus they are never adopted into Christ.
It causes them to turn against Christ and his command.
Jesus prophesied offences would come and that children would be offended so that they would not follow Jesus.
Mat 18:6 But whoso shall offend one of these little ones which believe in me, it were better for him that a millstone were hanged about his neck, and that he were drowned in the depth of the sea.
Mat 18:7 Woe unto the world because of offences! for it must needs be that offences come; but woe to that man by whom the offence cometh!
Those who first introduced infant baptism certainly caused an offence, they will be judged by Christ. Of course they see us as the ones causing offense by refusing infant baptism.
It just depends upon who is correct. Articles posted lower will clarify who is correct.
Paul wrote we are sons of God through faith in Christ Jesus, Catholics and others teach this can be our own faith or the faith of others.
Galations makes it clear it is those who know God who are being referenced.
Gal 3:26 For ye are all the children of God by faith in Christ Jesus.
Gal 3:27 For as many of you as have been baptized into Christ have put on Christ.
This is the person putting Christ on, and they knew God.
Gal 4:8 Howbeit then, when ye knew not God, ye did service unto them which by nature are no gods.
Gal 4:9 But now, after that ye have known God, or rather are known of God, how turn ye again to the weak and beggarly elements, whereunto ye desire again to be in bondage?
The sequence of Galations makes it clear they knew God and it was through their own faith adoption took place. They turned from idolatry to Christ.