How generative AI works
Generative AI operates through a multi-step process that transforms your input into meaningful output:
Core components
Prompts are the instructions you give to the AI model. They can be short questions, detailed instructions, or examples of the desired output format. Learn effective prompting techniques to get the results you want. Foundation models are large neural networks trained on vast amounts of text data. Writer offers multiple Palmyra models with different capabilities, from fast text generation to advanced reasoning and tool calling. Tokenization breaks down your input into smaller units (tokens) that the model can process. Understanding tokens and pricing helps you improve costs and performance. Neural network processing is where the model analyzes patterns, context, and relationships to determine the most appropriate response based on its training. Safety filtering checks generated content for harmful, biased, or inappropriate material. Writer includes built-in safety features to ensure responsible AI usage.Writer’s model capabilities
Palmyra models
Writer’s Palmyra models provide different capabilities optimized for various use cases. Palmyra X5 is the latest and most advanced model with a 1M token context window, adaptive reasoning, and speed and cost efficiency. There are also specialized models for specific use cases, such as Palmyra Med for medical and healthcare applications, and Palmyra Fin for finance.Specialized features
- Tool calling: Enable models to use external tools and APIs for enhanced functionality
- Vision capabilities: Process and analyze images alongside text using vision tools
- Knowledge Graph integration: Connect to your data sources for accurate, contextual responses using Knowledge Graph
- Streaming: Get responses in real-time for better user experience with streaming
Best practices
Prompt engineering
- Be specific: Provide clear, detailed instructions for what you want
- Use examples: Show the model the format or style you’re looking for
- Provide context: Give relevant background information
- Iterate and refine: Test different approaches to improve results
- Learn more: Explore prompting techniques for advanced strategies
Safety and reliability
- Review outputs: Always check generated content before using it
- Set boundaries: Define what the AI should and shouldn’t do
- Monitor performance: Track quality and adjust as needed
- Handle errors gracefully: Plan for cases where the AI doesn’t perform as expected
Performance optimization
- Choose appropriate models: Select the right Palmyra model for your use case
- Optimize prompts: Use clear, concise language and follow common prompting strategies
- Manage context length: Stay within token limits for best performance
- Use streaming: Enable streaming responses for real-time delivery
- Fine-tune parameters: Adjust model parameters for optimal results
Getting started with Writer
To begin using Writer’s generative AI in your applications:- Choose a model from Writer’s available models that fits your needs
- Design effective prompts using prompting techniques
- Test and iterate to improve performance
- Implement safety measures using Writer’s built-in safety features
- Monitor and optimize for ongoing success
Next steps
- Start with the API quickstart to get up and running
- Explore Writer’s models to find the right fit for your use case
- Learn prompting techniques for better results
- Understand model parameters for fine-tuning
- See how to integrate with your applications
- Build no-code agents for rapid prototyping
- Connect your data with Knowledge Graph for accurate responses