Yes, it would be best to call the customer care center and ask what to do.
I am guessing that it's quite possible with a 6-cell battery, but backup time will be less. But, you need to be sure, so better to confirm.
You can also search online, for the model number of your laptop/battery, to see if it is available. But, first talk to customer care.