u/tzilliox

Hi everyone I was playing around with fine tuning a Vision transformer (from HF) using TensorFlow and here is a summary of the lessons learned:

Ensemble heads don't help; a full-model ensemble might, but is likely too resource-intensive.

Sequentially unfreezing layers during fine-tuning improved performance.

A cosine decay learning rate schedule with warm-up yielded better fine-tuning results.

Data augmentation helped on the original dataset but appeared to confuse the model on extended data.

Transformers 5.x dropped TensorFlow support - pin to transformers==4.44.0.

Keras doesn't summarize layers correctly in this setup; a workaround is needed.

Notebook: https://www.kaggle.com/code/thomasprzilliox/vision -transformer-vit-for-flower-classification

Does anyone have a good solution for the last point ? Any tricks to have model.summary() working with every Hugging Face model ?

Hi everyone I was playing around with fine tuning a Vision transformer (from HF) using TensorFlow and here is a summary of the lessons learned:

Ensemble heads don't help; a full-model ensemble might, but is likely too resource-intensive.

Sequentially unfreezing layers during fine-tuning improved performance.

A cosine decay learning rate schedule with warm-up yielded better fine-tuning results.

Data augmentation helped on the original dataset but appeared to confuse the model on extended data.

Transformers 5.x dropped TensorFlow support — pin to transformers==4.44.0.

Keras doesn't summarize layers correctly in this setup; a workaround is needed.

Notebook: https://www.kaggle.com/code/thomasprzilliox/vision-transformer-vit-for-flower-classification

Does anyone have a good solution for the last point ? Any tricks to have model.summary() working with every Hugging Face model ?

I found https://seasonly.ch/en/ which only suggest recipes with seasonal ingredients, often local/seasonal ingredients are more healthy and more sustainable.

What do you think? Are you also favoring local/seasonal products?

I made https://seasonly.ch/en/ to do the following:

• suggest recipes with seasonal ingredients

• suggest recipes based on the left over of your fridge

• organize/plan your meal in a calendar (logged in user only)

• give some environmental impact on each recipe

I want to improve it and I would love any feedback 🙌🏻

Source: https://seasonly.ch/en/recipes/47

Ingredients:

• Pizza dough

• Block olives

• Zucchini

• Cherry Tomato

• Basil

• Tomato sauce

Steps:

• Preheat the oven at 220°C

• Spread the tomato sauce on the pizza dough

• Arrange the zucchini strips, cherry tomatoes, and olives evenly over the pizza

• Bake for 25-30 minutes