There are 2 main ways to alter the way llms like chatgpt respond: 1) training & fine-tuning and 2) prompting.
Prompting means feeding the LLM information in the form of text, so it has actual stuff in what you could call its “short-term memory”. That can be done interactively and only allows you to feed it a limited number of words.
Training and tuning are much slower processes and are used to build up and refine the “long-term” memory and to give importance and detail to specific topics, or to reinforce some kind of trait, like tone or type of answers it can produce.
I’m pretty sure what ibm and nasa did was a round of fine-tuning with material in that area of knowledge, not just prompting.
Let me mansplain this.
There are 2 main ways to alter the way llms like chatgpt respond: 1) training & fine-tuning and 2) prompting.
Prompting means feeding the LLM information in the form of text, so it has actual stuff in what you could call its “short-term memory”. That can be done interactively and only allows you to feed it a limited number of words.
Training and tuning are much slower processes and are used to build up and refine the “long-term” memory and to give importance and detail to specific topics, or to reinforce some kind of trait, like tone or type of answers it can produce.
I’m pretty sure what ibm and nasa did was a round of fine-tuning with material in that area of knowledge, not just prompting.