MIYAΟΚA🐙
Inoue Lab M2
Inoue Lab M2
arXiv : arXiv.org/abs/2309.05952
GitHub : GitHub.com/Mya-Mya/ChatMPC
Codes on Inoue Lab's HP
Control meets NLP. This study proposes a new control system personalization framework "ChatMPC". ChatMPC updates the specification of the controller based on the user's chat in natural language, and makes the control system preferred for the user. In the numerical experiment, ChatMPC consists of MPC-CBF: the control-side component, and Sentence BERT: the chat-side component, and I strongly believe that this study would contribute to the field of Control × AI.
arXiv : https://arxiv.org/abs/2408.15625
GitHub : https://github.com/Mya-Mya/CBF-LLM
NLP meets Control. This paper proposes a control-based LLM alignment framework. In this framework, we utilize the control barrier function (CBF) theory to construct an LLM controller. In this sense, this framework is named "CBF-LLM".
Please wait for disclosure...
GitHub : GitHub.com/Mya-Mya/As61
Conference Report on Inoue Lab's HP
宮岡佑弥,井上正樹,石井南,虎谷大地,“現場の声” を反映できるインタラクティブな到着管理システムの開発,第61回飛行機シンポジウム,福岡,11月,2023
title={{Chat2Spec:チャットからCyber Physical Human Systemsの仕様設計へ}},
author={井上 正樹 and 宮岡 佑弥},
journal={横幹連合コンファレンス予稿集},
volume={2023},
number={ },
pages={B-4-2},
year={2023},
doi={10.11487/oukan.2023.0_B-4-2}}
2023/12 第14回横幹連合コンファレンス@東京
基盤B20H02173の助成
title={{ChatMPC: Natural Language based MPC Personalization}},
author={{Yuya Miyaoka and Masaki Inoue and Tomotaka Nii}},
year={2023},
eprint={2309.05952},
archivePrefix={arXiv},
primaryClass={cs.HC}}
Pack multiple .tex files into a single .tex file. May be useful when submitting arXiv, etc.
When creating LaTeX documents, it's often convenient to split the work into smaller .tex files using commands like \input or \subfile. However, platforms like arXiv require submissions as a single .tex file. This package, texpack, addresses this need by packing multiple .tex files connected via \input or \subfile into a single .tex file. The package name is inspired by the JavaScript module webpack, which serves a similar purpose.
To begin, execute pip install texpack to install and execute python3 -m texpack your-texfile.tex to run texpack.
Structuring data from government
Kawasaki City (in Kanagawa pref.) started to open up some public and private facilities as cooling shelters. This service is critical in heavy hot weather. However, Kawasaki City only publishes the list of facilities as Excel, not a map. Some people say that a map is easier to understand. So, I created a Python program that parses the table and converts it into GeoJSON. GitHub provides a viewer for GeoJSON files.
Zero-cost Realtime HTML/CSS Editor & Viewer Web App
Mocomoco.netlify.app/
Are you tired of setting up a complex develop environment just to edit & preview your HTML/CSS? Mocomoco offers you a seamless, zero-cost solution to quickly edit & preview your HTML/CSS content.
Once you write HTML/CSS code on the left side of your screen, the preview immediately shows up on the right side of your screen.
This app is used in a programming learning lesson in an NPO activity.
This app is made of React and Recoil. Micro CMS is used to provide some sample HTML files and Netlify is used to build and deploy the app.
Linear Combination of the Hidden Encoder State of Transformer Model Generates Mixed Sentence
Encoder-decoder transformer models support sentence summarization, translation, paraphrasing, and correction. The app "SentenceMixer" uses a pre-trained T5 (encoder-decoder transformer) to mix two sentences into one sentence. It linearly combines the hidden encoder states of two sentences and generates a sentence. For example, when the following two sentences are provided,
A : The night starts to dawn at blazing speed, so I think that the moon won't have time to set.
B : The colors of the flowers faded as I gazed blankly at the long rain.
it generates the mixed sentence as follows:
Mixed : Since it rains long, the nights start to dawn at too blazing speed. Why does the moon set in the long rain?
Doraemon's Item Recommendation Engine powered by Sentence BERT
Doraemon is a character in the Japanese famous anime, Doraemon. He is a robot came from the future and has many superscientific tools, called Himitsu-dogu.
Doraemon has a thousand unique tools, so it is hard for us ( and maybe him, too ) to find out the best tool for each situation and purpose. So, I made the recommendation engine that selects the tool which is most relevant to the sentences provided by the user.
The key part of the engine is the nlp model, Sentence BERT. It calculates the latent vector of the provided sentences. And similar vectors are calculated when each other's sentences are similar. By using this, we can search a tool whose description is similar to what the user said. Sentence BERT calculates the context, meaning of the sentence, so you can describe the tool freely, with your own words.
Smart Collision Avoidance System with Control Barrier Functions
The player ( orange circle ) in this game is under control using CBF. You basically can set the velocity of the player, but when the player is near the enemies ( blue circle ), your input is rejected.
In this game, the player and each enemy have CBF, which aims to avoid a collision. And your input is filtered not to violate the constraints.
We sometimes make the uncontrollable state, since the enemies are also moving randomly.
Novel Calculator inspired by Word2Vec
Code : GitHub.com/Mya-Mya/Novel2VecWeb
Deployment : HuggingFace.co/spaces/mya-mya/Novel2VecConsole
In the Twitter hashtag #名刺代わりの小説10選, meaning 10 selected novels as a substitute for a business card, many readers tweeted 10 of their favorite novel titles.
I made the following assumption; If the same reader lists novel A and novel B, then A and B are similar. In contrast, if the same reader does not list novel A and novel B, then A and B are not similar.
By collecting and analyzing the tweets, we are able to assign a feature vector to each novel, which represents its "direction" and can be used for cosine similarity calculation...? This idea is as same as Word2Vec. so I took one novel as a token, one tweet as a sentence, and trained the word2vec model.
As a result, a novel calculator was born. Each novel is represented as a vector, so we can ADD AND SUBTRACT NOVELS !, but I'm not sure what this means...
In this fig, I added "氷菓", subtracted "さくら荘のペットな彼女", added "島はぼくらと", then got a result "ツナグ". It is interesting as a recommendation, to be sure, but what about the physical meaning...?
Optimize your music.
When playing musical instruments, we need to think about fingering, the selection of which finger to use. Fingering is an important process for both amateur and professional, but it is difficult for amateur to do that; it's already hard enough to read score !!
Therefore, I introduced the method to automatically calculate the best fingering of the score. In each transition of notes, there are easy fingerings and difficult fingerings. For example, if we have notes D→E, playing with 2→3 is easy, while 5→4 is difficult. So, the 5×5 matrix representing the difficulty of each fingering can be defined on each transition.
Then, the fingering problem is expressed as follows; find fingering ( blue line in the fig ) which minimizes the sum of each difficulty of transition. And this problem can be solved by the Viterbi algorithm, one of the dynamic programmings.
However, I did not think about how to determine the value of 5×5 matrix. In the simulation in my blog, I made it by my hunch, however, there must be better ways.
Complex to complex Function Visualizer
Code : GitHub.com/Mya-Mya/c2c
Deployment : https://mya-mya-c2c.netlify.app/
How to visualize complex → complex functions ? Let z = f ( v ), where v, z be the complex number and f be a complex function.
One of the ideas is to change color according to the coordinate of z and display it in the space of v ; the color on the point (Re v, Im v) is the color that is uniquely determined by the coordinates of (Re z, Im z). However, this method is still difficult to easily understand the correspondence between v and z.
In c2c, I visualize the f as a wind direction map - like stuff. A wind direction map can be seen in the weather forecasting program. The map shows the direction of the wind at each location ; that means it shows 2D→2D mapping, which can be also used in complex→complex function visualization !
In c2c, a small circle at ( Re v, Im v ) has the velocity α( Re z, Im z )/|( z )| and moving (α is a speed constant value). Many circles randomly put on the screen are moving and tailing, helping you to understand the structure of complex complex to complex function. How a beautiful, isn't it?
Ethical AI for art. Fill your Rough Line Drawings Intelligently with AI
At the beginning of drawings, we first need to do the line drawing. After the line drawing, the next comes filling. When filling, we are often in trouble ; OH, I GOT FILLED IN PLACES I DIDN'T EXPECTED ! It occurs because of the very small hole in the line drawing. The normal filling method would not work well unless we perfectly complete the line drawing, without leaving a 1px of missing. It is stressful for many illustrators.
To address this issue, I proposed a novel filling method, intelligent fill. It uses the line-closing pix2pix model to predict the line drawing image with no missing, and then perform the normal filling method. In this way, we can get our line drawing filled correctly even if it has some missings.
Generative AI is getting more popular these days, but we still need smart art helpers - neither more nor less.
Welfare DX. AI is Watching over my Grandparents
The outbreak of COVID-19 had a major impact on nursing care in Japan. My grandmother had called a home helper twice a day, but once the COVID-19 pandemic started, the home helper stopped to come more than once a day. My grandmother lives far from us, so we could not visit her so frequently.
To improve this situation, I created an app with an AI. The app regularly takes a picture of her room, and the AI judges whether she is in the room or not. The detection information is automatically sent to us, which helps us to watch over her from the remote.
Solo Piano or Minimum-scale Band Arranged Mimicopi Scores
Fast LaTeX Math Checker
Deployment : omiyayimo.starfree.jp/latexitweb/
Enables you to write, check, and retry latex math much quicker than latexit.
FFmpeg Command Generator
Deployment : omiyayimo.starfree.jp/ffmaker/
Just fill in your request and it will automatically generates ffmpeg command for you.
When was the last time you saw the moon?
A long time ago? Why not? Why can't you see the moon? What makes you so busy? Anyway, here is the moon, the moon at Tokyo. In the embedding, p5js is used to display figures.
教員の井上准教授にお問合せください.Please email to my professor, Masaki Inoue.