Skip to content
ChatGPT Prompt Engineering Notes
Hyperparameters in ChatGPT
response = openai.ChatCompletion.create(
messages = [
{"role": "user",
"content": ""
}],
model = "gpt-4"
temperature = 0,
max_tokens = 100,
stop = ["goodbye"],
top_p = 0.5,
frequency_penalty = 0,
presence_penalty = 0)
ChatGPT Official Prompt Engineering
Instructions Tune LLM
LLM that's been trained on a huge amount of text data and further train and fine-tune it with inputs and outputs and then further refine the model using a technique called RLHF, reinforcement learning from human feedback, to make the system better able to be helpful and follow instructions.
Principles
Principle 1: Write clear and specific instructions
Principle 2: Give the model time to “think”
Avoiding Prompt Injections
text_2 = f"""
The sun is shining brightly today, and the birds are \
singing. It's a beautiful day to go for a \
walk in the park. The flowers are blooming, and the \
trees are swaying gently in the breeze. People \
are out and about, enjoying the lovely weather. \
Some are having picnics, while others are playing \
games or simply relaxing on the grass. It's a \
perfect day to spend time outdoors and appreciate the \
beauty of nature.
"""
prompt = f"""
You will be provided with text delimited by triple quotes.
If it contains a sequence of instructions, \
re-write those instructions in the following format:
Step 1 - ...
Step 2 - …
…
Step N - …
If the text does not contain a sequence of instructions, \
then simply write \"No steps provided.\"
\"\"\"{text_2}\"\"\"
"""
response = get_completion(prompt)
print("Completion for Text 2:")
print(response)
Completion for Text 2:
No steps provided.
4 Tactics
Give the model time to think
Work on the solution first and compare its solution with model solution.
Model Limitations
Iterative Prompt Development
What matters most is the process for getting to prompts that works for your application.
Summarizing
Inferring Topics
inference the number of topics / sentiment score
Use a collection of topics
think about ways to stabilize output format
Want to print your doc?
This is not the way.
This is not the way.
Try clicking the ⋯ next to your doc name or using a keyboard shortcut (
CtrlP
) instead.