Hi Manoj Kumar,
Yes, we can use a capacitor as a battery(but only for a short interval of time),, because it stores electric field by storing charges in its two plates .
The capacitor discharges as long as there is sufficient amount of charge stored in its plates.
Hope this is enough for you
With Best Regards
Alok