You can remove the file from the local cache first and push that

git rm --cached /file/to/be/removed/from/cache

Then do the status to see the delete has taken place

git status

You will see something like
deleted: /file/to/be/removed/from/cache
Then push the change

git push