I’ve been play around with ollama. Given you download the model, can you trust it isn’t sending telemetry?

  • acockworkorange
    link
    fedilink
    arrow-up
    5
    ·
    7 hours ago

    Containers don’t really slow down apps significantly. It’s not a VM, it’s still a native app running in your kernel, just on a separate memory space and restricted access to hardware.

    • Jack@slrpnk.net
      link
      fedilink
      arrow-up
      2
      ·
      6 hours ago

      That is true for Linux and maybe Mac, but on windows I think they have a bit more overhead. But again I agree that in most cases it is not significant.

      • acockworkorange
        link
        fedilink
        arrow-up
        4
        ·
        6 hours ago

        It’s the overhead because of containers or is it because you’re running something that is meant to run on Linux and is using a conversion layer like MinGW ?

        • stink@lemmygrad.ml
          link
          fedilink
          English
          arrow-up
          1
          ·
          57 minutes ago

          Windows > Windows Subsystem for Linux (WSL) Ubuntu > docker container

          I think WSL 2 actually runs Linux in a virtual environment. I’ve tried getting my own LLM instance running on my windows machine but it’s been such a pain.