Question: Wants to know what will happen if the Crystal is not connected to the X1 input and it remains connected to the X2 side. What will happen?

Answer: Chances are this would not damage the chip/system -- it just wouldn't work. By not having an input to X1, this is not allowing the feedback loop to complete and therefore not generating an input clock.