I am looking to replace my old PC, and wondering what other people use.

Do you use your own hardware? If so, what do you have? What do you think gives you the most bang for your buck at the moment?

Do you use the cloud instead? If so, why? Which service(s) do you use?

Thank you!

  • __forward__
    link
    fedilink
    English
    arrow-up
    3
    ·
    1 year ago

    I think major training should just be done on dedicated servers/on the cloud. That being said it is very helpful to test locally, so in case you are planning on using Nvidia equipped servers just get any somewhat recent consumer Nvidia card and you can always run locally on some sample data and test much more easily.

    • konodas@feddit.de
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      1 year ago

      I second that. Being able to test medium sized models locally can make debugging much easier.

      I have a 3070 with 8GB VRAM, which can train e.g. a GPT2 with a batch-size of 1 with full precision.

  • radical_action@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    I would suggest just getting a laptop and nice external interface (keyboard/mouse if you prefer, nice monitor) + remote server. I bought a desktop + gpu setup back when I started my masters, but I use it shockingly little for work. The type of work that a single gpu + local machine incetivize are usually against good scientific and experimental practice. You dont really want that running jobs during the day.

    As for specific cloud reccomendations, I have none. I just use what is available at my institution.

    • joelthelion@lemmy.mlOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      1 year ago

      Interesting! How do you use it? Do you connect it to your main PC? How?

      Also, what RAM does it use? Does it use the main system RAM?