Step 1. Defrost tilapia fillets before cooking them. You can bake frozen fillets in the oven, but it takes longer and yields unevenly cooked results. Stick these thin fillets in the fridge overnight or soak them in their airtight wrappings in a bowl of cold water for about 45 minutes, replacing the water with colder water halfway through.