How many GPUs do you use for your research?
I come from a more traditional ML/stats background. So far, I’ve mostly used CPU HPC clusters and only used a GPU once.
I’d like to move more into deep learning, especially AI for biology, and I’m curious how much GPU compute people typically use in research.
I know it depends a lot on the field and the project, but for something like a NeurIPS or ICML paper—not training a foundation model from scratch, but working on a smaller multimodal model, GNN, VAE, etc.—how many GPUs do you usually need?