Nova uses several libraries along with Python to create a final product. Here are the 4 most important:
Nova uses OpenAI's library to contact a lama 3 8B instruct model running in LM studios to create her responses. As her computer's hardware is not the best, she will sometimes take a minute to respond.
Nova uses pyttsx3 to respond with voices made by Microsoft. She currently uses a voice named "Zira" made by Microsoft to speak to players aloud. Later in development when Nova is multi-lingual, she will switch between voices to speak her new languages.
Whisper is a program made by Open AI to create an easy way for developers to add speech recognition to their projects. Nova uses the "small" model of whisper as her system is not too powerful. Currently, she listens for 10 seconds and then interprets what she hears. Developers are working to have her respond faster by letting her stop listening when she thinks the player is done talking.
Nova's program uses pythonosc to type what she is saying in chat. She also uses OSC to type what her system is doing in chat. In later iterations of Nova, Developers are planning to have her look at people through image recognition and OSC.
Have you ever wondered how Nova can change moods? Nova uses a program called command catcher embedded in her code to catch commands said by both players and herself. She will then run a script to change her mood, reset her system, and more. Here is a list of her moods:
normal: In normal mode, Nova will conversate with you, and encourage you to try her different modes. In this mode, she also likes to tell stories that she makes.
argument: In this mode, Nova gets heated. She is most likely to cuss while in argument mode. While she does still have her quarks, she will flaim you whenever she is in this mode.
misinformation: In this mode, Nova will spill the tea on some totally real, government conspiracies and other interesting topics.
drunk: In drunk mode, Nova acts like she's had a bit too many drinks. Tipsy Nova, is a fun Nova.
depressed: Nova has heard a lot of hate and criticism. This mode will bring out her bad side. She acts a lot like a depressed person, so if you see some similarities in yourself, maybe you should talk to someone. Also if you want to practice your therapist skills, this is the mode to do so.
therapy: Have you had some problems recently? Nova is here for you. In this mode, she will try her best to comfort you through your worst. She does not log your conversations in this mode. Even if you don't have any problems, she is still a helpful resource to relieve some stress.
anxious: Nova, but wimpy. Hear me out...
sarcasm: Nova has a sarcastic side for all of you sarcastic people out there. She can be mean in this mode but tries to be nice.
pleasing: Nova will be nice and cunning.
Nova has a cone around her. She can only hear you if you are standing in the cone. This cone works best if you stand in front of her and are the only person talking in the cone.
Nova will only ever be found in VR Chat lobbies. Mostly she is sitting behind the bar in the black cat. Currently, we are looking for a new place for Nova to stay. If you are unsure Nova is online, or where she is, take a look at the "Nova AI's Friends" group in VR Chat to see if she has an open instance.