The bot just makes use of:

  • SMMRY - I’m evaluating this and might eventually switch over to some ml library
  • LemmyBot

As posts come in on a news community (via LemmyBot), I grab the url and pass it to smmry, and reply. And that’s it.

Update June 22, 2023: I’ll probably stop using SMMRY as it’s pretty buggy and not usable ~20% of the time. I’m thinking about using a headless browser (like Selenium), grabbing the text, and using GPT to analyze and summarize the text. I need to try this out and guesstimate the pricing for it.

  • Bloodbeech ForestEnglish
    1·
    1 year ago

    I’m thinking about using a headless browser (like Selenium), grabbing the text, and using GPT to analyze and summarize the text. I need to try this out and guesstimate the pricing for it.

    There are plugins these days that you can make the LLM use to search, retrieve and extract content from the web. If you have OpenAI API access you can use that, or you could host an open model yourself (but I’m not sure what the situation is in regards to how well those handle plugin tool use).