Yes! They will be able to retain their knowledge of any languages they have prior to arriving in Inaba, even if that language doesn't naturally exist in the world of Caligo. They will also be able to write in these languages and so on. Japanese is what will feel most natural to them upon arrival, but the knowledge of any languages known will be retained and they will be able to communicate in them if they wish.