Biden didn't take the oath. They left out, "To protect and defend the Constitution against all enemies foreign and Domestic and to bear true faith and Allegiance to the same....".
Not to mention he was sworn in at 11:50 am while Trump was still POTUS!