Let A be any matrix such that A2=0 matrix then does it implies A is a zero matrix?

yes

Not necessarily. 

If A² = 0, then such matrix A is known as Nilpotent Matrix. 

e.g. A = 

This matrix A is not equal to zero but A² will be equal to zero. 

Not at all. Consider A = 0 1