• fuzzywolf23@beehaw.org
    link
    fedilink
    arrow-up
    9
    ·
    1 year ago

    And no SO means worse LLMs. Chatgpt relies on scrapes of SO, reddit, forums and GitHub discussion pages.

    • smoothbrain coldtakes@lemmy.ca
      link
      fedilink
      arrow-up
      3
      ·
      1 year ago

      It’s not like ChatGPT is the only LLM. GPT is pretty broad and general. Remember that MS has Co-Pilot which is literally entirely built on GitHub’s codebase knowledge. Different data sets will produce different kinds of useful predictors.

    • arthur@lemmy.zip
      link
      fedilink
      arrow-up
      3
      ·
      edit-2
      1 year ago

      And the scrapping stage already happened. A new one will be useful only after enough human-made content is added, or it a major change in tech happen.