Former Guantanamo Bay detainees on Tuesday thanked the people of Palau for taking them in, but signaled the Pacific Island nation would be only a temporary home.

“We are extremely grateful to the president of Palau and the people of Palau who have graciously accepted us and given us this home,” Abdul Ghappar Abdul Rahman told The Associated Press, in the first comments by the former detainees since they arrived on Sunday.