Hi Christina
The default value for City/Town is under Site admin > Location > Location settings
I couldn't see a setting to input the default Department - it is possible to set default values for custom fields but this field is an optional field. To get around the default value you can include the department field in the upload file with a blank value.
Check the more detailed instructions for uploading users to see if I haven't missed anything.
Regards