Name | Type | Description | Options |
---|---|---|---|
Annotated text | Object | Value array with text/annotations. Must be a JSON string or a state reference to an array. |
|
Reference | Color | The colour to be used as reference for chroma and luminance, and as the starting point for hue rotation. |
|
Seed value | Number | Choose a different value to reshuffle colours. |
|
Rotate hue | Text | If active, rotates the hue depending on the content of the string. If turned off, the reference colour is always used. |
|
Copy buttons | Text | If active, adds a control bar with both copy text and JSON buttons. |
|
Button | Color |
|
|
Button text | Color |
|
|
Primary text | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Name | Text |
|
|
Image source | Text | A valid URL. Alternatively, you can provide a state reference to a packed file. |
|
Caption | Text | Add an optional caption under the name, such as the person's job title. |
|
Size | Text |
|
|
Orientation | Text |
|
|
Primary text | Color |
|
|
Secondary text | Color |
|
|
Separator | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Text | Text |
|
|
Disabled | Text | Disables all event handlers. |
|
Button | Color |
|
|
Button text | Color |
|
|
Icon | Text | A Material Symbols id, such as "arrow\_forward". |
|
Button shadow | Shadow |
|
|
Separator | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Conversation | Object | An array with messages or a writer.ai.Conversation object. |
|
Assistant initials | Text |
|
|
User initials | Text |
|
|
Use Markdown | Text | If active, the output will be sanitized; unsafe elements will be removed. |
|
Enable file upload | Text |
|
|
Placeholder | Text |
|
|
Assistant role | Color |
|
|
User role | Color |
|
|
Avatar | Color |
|
|
Avatar text | Color |
|
|
Accent | Color |
|
|
Container background | Color |
|
|
Primary text | Color |
|
|
Secondary text | Color |
|
|
Separator | Color |
|
|
Button | Color |
|
|
Button text | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Label | Text |
|
|
Options | Key-Value | Key-value object with options. Must be a JSON string or a state reference to a dictionary. |
|
Orientation | Text | Specify how to lay out the options. |
|
Primary text | Color |
|
|
Accent | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Label | Text |
|
|
Color List | Object | List of predefined colors |
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Title | Text |
|
|
Width (factor) | Number | Relative size when compared to other columns in the same container. A column of width 2 will be double the width of one with width 1. |
|
Sticky | Text |
|
|
Collapsible | Text |
|
|
Start collapsed | Text | Only applied when the column is collapsible. |
|
Separator | Color |
|
|
Padding | Padding |
|
|
Content alignment (H) | Align (H) |
|
|
Content alignment (V) | Align (V) |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Data | Text | Must be a state reference to a Pandas dataframe or PyArrow table. Alternatively, a URL for an Arrow IPC file. |
|
Show index | Text | Shows the dataframe's index. If an Arrow table is used, shows the zero-based integer index. |
|
Enable search | Text |
|
|
Enable download | Text | Allows the user to download the data as CSV. |
|
Use Markdown | Text | If active, the output will be sanitized; unsafe elements will be removed. |
|
Display row count | Number | Specifies how many rows to show simultaneously. |
|
Wrap text | Text | Not wrapping text allows for an uniform grid, but may be inconvenient if your data contains longer text fields. |
|
Primary text | Color |
|
|
Secondary text | Color |
|
|
Separator | Color |
|
|
Background | Color |
|
|
Font style | Text |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Label | Text |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Label | Text |
|
|
Options | Key-Value | Key-value object with options. Must be a JSON string or a state reference to a dictionary. |
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Label | Text |
|
|
Allowed file types | Text | Provides hints for browsers to select the correct file types. You can specify extensions and MIME types separated by comma, or leave empty to accept any file. |
|
Allow multiple files | Text |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
API Key | Text | API Key from Google Cloud Console. |
|
Map ID | Text | ID of map from Google Cloud Console, needed for markers. |
|
Map type | Text | One of 'roadmap', 'satellite', 'hybrid' or 'terrain'. |
|
Zoom | Number |
|
|
Latitude | Number |
|
|
Longitude | Number |
|
|
Markers | Object | Markers data |
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Text | Text |
|
|
Primary text | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Text | Text | Add text directly, or reference state elements with @{my_text}. |
|
Heading type | Text |
|
|
Alignment | Text |
|
|
Primary text | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Padding | Padding |
|
|
Content alignment (H) | Align (H) |
|
|
Content alignment (V) | Align (V) |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Element | Text | Set the type of HTML element to create, e.g., 'div', 'section', 'span', etc. |
|
Styles | Object | Define the CSS styles to apply to the HTML element using a JSON object or a state reference to a dictionary. |
|
Attributes | Object | Set additional HTML attributes for the element using a JSON object or a dictionary via a state reference. |
|
HTML inside | Text | Define custom HTML to be used inside the element. It will be wrapped in a div and rendered after children components. |
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Icon | Text | A Material Symbols id, such as "arrow\_forward". |
|
Icon size | Number | Icon size in px |
|
Icon color | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Source | Text | A valid URL |
|
Separator | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Source | Text | A valid URL. Alternatively, you can provide a state reference to a Matplotlib figure or a packed file. |
|
Caption | Text | Leave blank to hide. |
|
Max width (px) | Number |
|
|
Max height (px) | Number |
|
|
Secondary text | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Data | Object |
|
|
Initial depth | Number | Sets the initial viewing depth of the JSON tree hierarchy. Use -1 to display the full hierarchy. |
|
Hide root | Text | Don't show the type of the root node when it's an Object or an Array. |
|
Copy | Text | If active, adds a control bar with copy JSON button. |
|
JSON indentation | Width |
|
|
Accent | Color |
|
|
Secondary text | Color |
|
|
Separator | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
URL | Text | Specify a URL or choose a page. Keep in mind that you can only link to pages for which a key has been specified. |
|
Target | Text | Specifies where to open the linked document. |
|
Rel | Text | Specifies the relationship between the current document and the linked document. |
|
Text | Text | The text to display in the link. |
|
Primary text | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Access Token | Text | Access token from Mapbox |
|
Map style | Text | Map style URL |
|
Zoom | Number |
|
|
Latitude | Number |
|
|
Longitude | Number |
|
|
Markers | Object |
|
|
Controls visible | Text | Show map controls |
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Message | Text | Prefix with '+' for a success message, with '-' for error, '!' for warning, '%' for loading. No prefix for info. Leave empty to hide. |
|
Success | Color |
|
|
Error | Color |
|
|
Warning | Color |
|
|
Info | Color |
|
|
Loading | Color |
|
|
Primary text | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Name | Text |
|
|
Value | Text | The main value to be displayed. It's not limited to numbers. |
|
Description | Text |
|
|
Note | Text | Prefix with '+' for a positive message, with '-' for a negative message. |
|
Primary text | Color |
|
|
Secondary text | Color |
|
|
Positive | Color |
|
|
Neutral | Color |
|
|
Negative | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Label | Text |
|
|
Options | Key-Value | Key-value object with options. Must be a JSON string or a state reference to a dictionary. |
|
Placeholder | Text | Text to show when no options are selected. |
|
Maximum count | Number | The maximum allowable number of selected options. Set to zero for unlimited. |
|
Accent | Color | The colour of the chips created for each selected option. |
|
Chip text | Color | The colour of the text in the chips. |
|
Primary text | Color |
|
|
Secondary text | Color |
|
|
Container background | Color |
|
|
Separator | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Label | Text |
|
|
Placeholder | Text |
|
|
Minimum value | Number |
|
|
Max value | Number |
|
|
Step | Number |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Page | Number | The current page number. |
|
Page Size | Number | The number of items per page. |
|
Total Items | Number | The total number of items |
|
Page Size Options | Text | A comma-separated list of page size options. If it's empty, the user can't change the page size. Set your default page size as the first option. |
|
Show All Option | Text | Show an option to show all records. |
|
Jump To | Text | Show an option to jump to a specific page. |
|
Name | Type | Description | Options |
---|---|---|---|
PDF source | Text | A valid URL. Alternatively, you can provide a state reference to a packed PDF file. |
|
Highlights | Object | A list of highlights to be applied to the PDF as a JSON array of strings. |
|
Selected highlight match | Number | The index of the selected highlight match. |
|
Page | Number | The page to be displayed. |
|
Controls | Text | Show controls to navigate the PDF. |
|
Container background | Color |
|
|
Separator | Color |
|
|
Primary text | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Graph specification | Object | Plotly graph specification. Pass it using state, e.g. @{fig}, or paste a JSON specification. |
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Label | Text |
|
|
Options | Key-Value | Key-value object with options. Must be a JSON string or a state reference to a dictionary. |
|
Orientation | Text | Specify how to lay out the options. |
|
Primary text | Color |
|
|
Accent | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Label | Text |
|
|
Minimum value | Number |
|
|
Maximum value | Number |
|
|
Step size | Number |
|
|
Accent | Color |
|
|
Popover color | Color |
|
|
Popover background | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Label | Text |
|
|
Feedback | Text |
|
|
Minimum value | Number | Valid values are 0 and 1. |
|
Max value | Number | Valid values are between 2 and 11. |
|
Step | Number | Valid values are between 0.25 and 1. |
|
Accent | Color |
|
|
Primary text | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Repeater object | Object | Include a state reference to the dictionary used for repeating the child components. Alternatively, specify a JSON object. |
|
Key variable name | Text | Set the name of the variable that will store the key of the current repeater object entry. |
|
Value variable name | Text | Set the name of the variable that will store the value of the current repeater object entry. |
|
Name | Type | Description | Options |
---|---|---|---|
Component id | Text | The id of the component to reuse. |
|
Name | Type | Description | Options |
---|---|---|---|
Title | Text | Leave blank to hide. |
|
Collapsible | Text |
|
|
Start collapsed | Text | Only applied when the component is collapsible. |
|
Accent | Color |
|
|
Primary text | Color |
|
|
Secondary text | Color |
|
|
Container background | Color |
|
|
Container shadow | Shadow |
|
|
Separator | Color |
|
|
Button | Color |
|
|
Button text | Color |
|
|
Button shadow | Shadow |
|
|
Padding | Padding |
|
|
Content alignment (H) | Align (H) |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Label | Text |
|
|
Options | Key-Value | Key-value object with options. Must be a JSON string or a state reference to a dictionary. |
|
Placeholder | Text | Text to show when no options are selected. |
|
Maximum count | Number | The maximum allowable number of selected options. Set to zero for unlimited. |
|
Accent | Color |
|
|
Chip text | Color | The color of the text in the chips. |
|
Primary text | Color |
|
|
Secondary text | Color |
|
|
Container background | Color |
|
|
Separator | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Separator | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Start collapsed | Text |
|
|
Background | Color |
|
|
Accent | Color |
|
|
Primary text | Color |
|
|
Secondary text | Color |
|
|
Container background | Color |
|
|
Container shadow | Shadow |
|
|
Separator | Color |
|
|
Button | Color |
|
|
Button text | Color |
|
|
Button shadow | Shadow |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Label | Text |
|
|
Minimum value | Number |
|
|
Maximum value | Number |
|
|
Step size | Number |
|
|
Accent | Color |
|
|
Popover color | Color |
|
|
Popover background | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Name | Text |
|
|
Padding | Padding |
|
|
Completed | Text | Use a state reference to dynamically mark this step as complete. |
|
Content alignment (H) | Align (H) |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Accent | Color |
|
|
Primary text | Color |
|
|
Secondary text | Color |
|
|
Container background | Color |
|
|
Container shadow | Shadow |
|
|
Separator | Color |
|
|
Button | Color |
|
|
Button text | Color |
|
|
Button shadow | Shadow |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Label | Text |
|
|
Accent | Color |
|
|
Primary text | Color |
|
|
Separator | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Name | Text |
|
|
Padding | Padding |
|
|
Content alignment (H) | Align (H) |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Accent | Color |
|
|
Primary text | Color |
|
|
Secondary text | Color |
|
|
Container background | Color |
|
|
Container shadow | Shadow |
|
|
Separator | Color |
|
|
Button | Color |
|
|
Button text | Color |
|
|
Button shadow | Shadow |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Tags | Key-Value | Key-value object with tags. Must be a JSON string or a state reference to a dictionary. |
|
Reference | Color | The colour to be used as reference for chroma and luminance, and as the starting point for hue rotation. |
|
Seed value | Number | Choose a different value to reshuffle colours. |
|
Rotate hue | Text | If active, rotates the hue depending on the content of the string. If turned off, the reference colour is always used. |
|
Primary text | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Text | Text | Add text directly, or reference state elements with @{my_text}. |
|
Use Markdown | Text | The Markdown output will be sanitised; unsafe elements will be removed. |
|
Alignment | Text |
|
|
Primary text | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Label | Text |
|
|
Placeholder | Text |
|
|
Rows | Number |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Label | Text |
|
|
Placeholder | Text |
|
|
Password mode | Text |
|
|
Accent | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Label | Text |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Interval (ms) | Number | How much time to wait between ticks. A tick is considered finished when its event is handled. |
|
Active | Text | Whether the timer should trigger tick events. |
|
Accent | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Chart specification | Object | Vega-Lite chart specification. Pass a Vega Altair chart using state or paste a JSON specification. |
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Source | Text | The URL of the video file. Alternatively, you can pass a file via state. |
|
Controls | Text | Display video player controls. |
|
Autoplay | Text | Autoplay the video when the component is loaded. |
|
Loop | Text | Loop the video when it reaches the end. |
|
Muted | Text | Mute the video by default. |
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
Name | Type | Description | Options |
---|---|---|---|
Refresh rate (ms) | Number | Set to 0 for manual capture. |
|
Button | Color |
|
|
Button text | Color |
|
|
Button shadow | Shadow |
|
|
Separator | Color |
|
|
Custom CSS classes | Text | CSS classes, separated by spaces. You can define classes in custom stylesheets. |
|
{prompt}
### Instruction ###
Write a poem in the style of
Robert Frost.
### Question ###
What's the poem about?
Provide a list of idioms in English, along with their meanings and example
sentences.
Here is an example for the output:
An idiom: 'Break a leg'
Meaning: Good luck
Example sentence: 'I'm sure you'll do great in your interview.
Break a leg!'
System instruction: Create a product detail page for a
fictional innovative smartphone by a retailer known as "TechTrend
Electronics."
Prompt 1: Start by describing the unique features of the smartphone,
such as its solar-powered battery, triple-lens camera system, and foldable
screen technology.
Prompt 2: Next, outline the benefits of these features
for users, like extended battery life, exceptional photo quality, and
enhanced device portability.
Prompt 3: Conclude with crafting compelling product descriptions
and a call-to-action that entices customers to make a purchase during the upcoming
holiday sale.
Summarize a series of healthcare claims documents for a fictional
healthcare company, 'HealthFirst Solutions', using the following delimiter `\n`
to separate different sections of the summary:
Claim Number: 123456789 `\n`
Date of Service: January 1, 2024 `\n`
Diagnosis: Acute sinusitis `\n`
Total Claimed: \$300 `\n`
Status: Pending review `\n`
In this paper, we introduce the IFS, a metric for instruction following. The metric detects language models' ability to follow instructions. First, IFS can distinguish between base and instruct models. We benchmark public bases and models, showing they're well-formatted responses to partial and full sentences are effective. The metric can be used as a measure between model classes.
We compute IFS for Supervised early stopping. Follow instructions early and finetune later. As an example, we show model predictions are objective. We show that semantic changes can be caused by auxiliary metric ObjecQA. When IFS decomposes, it steepens. IFS and semantic factors start a controllable instruct trend. Tuning and querying opens minimal instruct interfaces Foundation models are short-lived.
Palmyra-20b and Palmyra-40b are two cutting-edge large language models (LLMs) that were fine-tuned and evaluated for medical language understanding tasks. By applying instruction-based fine-tuning on a custom-curated medical dataset of 200,000 examples, we create novel, fine-tuned models, Palmyra-Med-20b and Palmyra-Med-40b. Performance is then measured across multiple medical knowledge datasets, including PubMedQA and MedQA.
Our fine-tuned models outperform both their base counterparts and other LLMs pre-trained on domain-specific knowledge. This research demonstrates the effectiveness of instruction-based fine-tuning in enhancing LLMs performance in the medical domain.
Grammatical Error Correction (GEC) is the task of automatically detecting and correcting errors in text. The task not only includes the correction of grammatical errors, such as missing prepositions and mismatched subject-verb agreement, but also orthographic and semantic errors, such as misspellings and word choice errors respectively. The field has seen significant progress in the last decade, motivated in part by a series of five shared tasks, which drove the development of rule-based methods, statistical classifiers, statistical machine translation, and finally neural machine translation systems which represent the current dominant state of the art.
In this survey paper, we condense the field into a single article and first outline some of the linguistic challenges of the task, introduce the most popular datasets that are available to researchers (for both English and other languages), and summarise the various methods and techniques that have been developed with a particular focus on artificial error generation. We hope that this survey will serve as comprehensive resource for researchers who are new to the field or who want to be kept apprised of recent developments.
Open-domain question answering (QA) has recently made significant progress, with generative models like Transformers demonstrating impressive performance. However, these models are computationally expensive to train and query, limiting their practical application. In this whitepaper, we introduce a novel approach to open-domain QA that combines the strengths of retrieval and generative models, aiming to achieve more efficient and accurate question answering.
Our approach, termed Fusion-in-Decoder, retrieves informative passages and leverages them with a sequence-to-sequence model to generate answers. This method demonstrates state-of-the-art results on benchmarks like Natural Questions and TriviaQA, and offers a highly scalable framework for aggregating and combining information from multiple passages.
For decades, human-computer interaction has fundamentally been manual. Even today, almost all productive work done on the computer necessitates human input at every step. Autonomous virtual agents represent an exciting step in automating many of these menial tasks. Virtual agents would empower users with limited technical proficiency to harness the full possibilities of computer systems. They could also enable the efficient streamlining of numerous computer tasks, ranging from calendar management to complex travel bookings, with minimal human intervention.
In this paper, we introduce OmniACT, the first-of-a-kind dataset and benchmark for assessing an agent's capability to generate executable programs to accomplish computer tasks. Our scope extends beyond traditional web automation, covering a diverse range of desktop applications. The dataset consists of fundamental tasks such as "Play the next song", as well as longer horizon tasks such as "Send an email to John Doe mentioning the time and place to meet". Specifically, given a pair of screen image and a visually-grounded natural language task, the goal is to generate a script capable of fully executing the task.
We run several strong baseline language model agents on our benchmark. The strongest baseline, GPT-4, performs the best on our benchmark However, its performance level still reaches only 15% of the human proficiency in generating executable scripts capable of completing the task, demonstrating the challenge of our task for conventional web agents.Our benchmark provides a platform to measure and evaluate the progress of language model agents in automating computer tasks and motivates future work towards building multimodal models that bridge large language models and the visual grounding of computer screens.
This research paper presents a comprehensive analysis of integrating advanced language models with search and retrieval systems in the fields of information retrieval and natural language processing. The objective is to evaluate and compare various state-of-the-art methods based on their performance in terms of accuracy and efficiency.
The analysis explores different combinations of technologies, including Azure Cognitive Search Retriever with GPT-4, Pinecone's Canopy framework, Langchain with Pinecone and different language models (OpenAI, Cohere), LlamaIndex with Weaviate Vector Store's hybrid search, Google's RAG implementation on Cloud Vertex AI Search, Amazon SageMaker's RAG, and a novel approach called KG-FID Retrieval.
The motivation for this analysis arises from the increasing demand for robust and responsive question-answering systems in various domains. The RobustQA metric is used to evaluate the performance of these systems under diverse paraphrasing of questions. The report aims to provide insights into the strengths and weaknesses of each method, facilitating informed decisions in the deployment and development of AI-driven search and retrieval systems.
In this paper, we introduce Writing in the Margins (WiM), a new inference pattern for Large Language Models designed to optimize the handling of long input sequences in retrieval-oriented tasks. This approach leverages the chunked prefill of the key-value cache to perform segment-wise inference, which enables efficient processing of extensive contexts along with the generation and classification of intermediate information ("margins") that guide the model towards specific tasks.
This method increases computational overhead marginally while significantly enhancing the performance of off-the-shelf models without the need for fine-tuning. Specifically, we observe that WiM provides an average enhancement of 7.5% in accuracy for reasoning skills (HotpotQA, MultiHop-RAG) and more than a 30.0% increase in the F1-score for aggregation tasks (CWE).
Additionally, we show how the proposed pattern fits into an interactive retrieval design that provides end-users with ongoing updates about the progress of context processing, and pinpoints the integration of relevant information into the final response. We release our implementation of WiM using Hugging Face Transformers library at [https://github.com/writer/writing-in-the-margins](https://github.com/writer/writing-in-the-margins).
{prompt}