I saw Generative AI for Beginners from Microsoft on GitHub. I’ve looked at https://fmhy.pages.dev/ai but I’m not sure what I’m really looking for.

I write fiction, and I want a chatbot that will function like chat gpt3.5, but not shut down if things get bloody or sexy, as they so often do.

You know ready, aim, fire? I’m in the AIM stage.

  • blargbluuk@sh.itjust.works
    link
    fedilink
    arrow-up
    1
    ·
    edit-2
    4 months ago

    LM Studio is one of the most user friendly ways to play around with LLMs imo. You can run some of the smaller models without too much memory (it will be slow without a decent GPU though).

  • CetaceanNeeded@lemmy.world
    link
    fedilink
    arrow-up
    1
    ·
    4 months ago

    I’ve been using GPT4All on my laptop and using mostly 7B models due to my RAM limitations and I am amazed how good some of them are.

    It’s been really easy to use. There are models you can download from within the UI or you can get adventurous and download them from elsewhere, they just need to be in the .gguf format. I get most from TheBloke on hugging face.

    So far my favourite has been solar-10.7B-instruct-v1.0-uncensored, it has been astonishingly good.

    • Melatonin@lemmy.dbzer0.comOP
      link
      fedilink
      arrow-up
      1
      ·
      4 months ago

      I’ve been doing that for 40+ years. I just want to try using AI as a partner to bounce ideas back and forth. As I explained in another post, I have trouble generating alternatives once I’ve created an Idea. It’s nice to have a means to get outside myself.

      I intend to do the writing, it’s the planning and plotting I’m using AI for.

  • Mahlzeit@feddit.de
    link
    fedilink
    arrow-up
    1
    ·
    4 months ago

    You should probably hook up with the SillyTavern crowd. It’s a frontend to chat with LLMs that will do what you want. Its main purpose is chat role-play. You can assign a persona to the LLM and ST will handle the prompt to make it work. It also handles jailbreaks if you want to use one of the big ones (no idea if it works well). You can also connect to other services that run open models, including aihorde.

    https://github.com/SillyTavern/SillyTavern

    https://www.reddit.com/r/SillyTavernAI/


    If you want to host your own model you can find more help here:

    https://www.reddit.com/r/LocalLLaMA/

    [email protected]

  • wathek@discuss.online
    link
    fedilink
    arrow-up
    1
    ·
    edit-2
    4 months ago

    I would look into NovelAI for writing, it’s quite specifically for that. It’s a paid servicd similar to chatgpt, but it’s uncensored and private.

    You can run your own lightweight LLM on a laptop but the output will be useless. Good output requires big boy compute.

    If you do want to run it on your own hardware, look into Ollama. There’s also options to run your own LLM in the cloud with a not too difficult process for non-techies.

    Frankly, id find the right LLM for your needs and just pay for it per month, maybe novelai, maybe something else, but chatgpt is not great for creative fiction.