Product Updates – June 2024
From the LLM from:
- Game-Changing Feature: JSON Output from LLM. You can now define the expected data structure from your unstructured data, allowing the LLM to output in JSON format. This improvement enables more precise and structured data extraction, simplifying your workflow and integration processes.
- Anthropic Sonnet 3.5 Model Now Available. We are excited to introduce the Anthropic Sonnet 3.5 model, now available for all users. This model offers advanced capabilities, ensuring more accurate and contextually relevant responses.
- Markdown Support Across Models. All models that support it can now provide answers in Markdown format. This feature enhances the readability and presentation of responses, making it easier to format text, include links, and structure information.
- Summarization with ChatGPT-4o. We have introduced a new feature that supports summarization using the ChatGPT-4o model. This will allow you to generate concise and informative summaries from longer texts, improving content management and accessibility.
- Customizable System Prompt in the New /ask Endpoint. The new /ask endpoint now allows you to customize the System Prompt, giving you greater control over the responses generated by the LLM. This customization helps tailor the model’s behavior to better suit your specific needs.
- Deprecation of ChatGPT-4. Please remind ChatGPT-4 will be deprecated on Friday, July 12. All users currently utilizing ChatGPT-4 will be automatically transitioned to ChatGPT-4o without any action required on your part. If you prefer a different LLM, you may change it according to your needs.
API Changes, Maintenance, and Upgrades
We are also making several important updates and enhancements to our API:
- Scheduled Maintenance Window. There will be a maintenance window on Monday, July 29th at 07:00 CEST (01:00 AM East Coast Time). During this time, our services may be temporarily unavailable as we perform necessary updates and improvements.
- Markdown Support for Link Ingestion and Processing. We now support Markdown for link ingestion and processing. This enhancement allows for seamless inclusion of URLs in your responses, enabling the creation of answers with embedded links without much hassle.
- Enhancements to the Ranking Algorithm. Starting Monday, July 15th, we will introduce enhancement features that improve our ranking algorithm. These updates are designed to deliver better retrieval results, though please note that the same queries over the same data may yield different results than before due to these improvements.
- Deprecation of /chat Endpoint. Let us remind our users we are deprecating the /chat endpoint and replacing it with the new /ask endpoint. For more information and documentation on this change, please visit: Nuclia Documentation.
Enhancements to User Experience
In addition to the above updates, we have been working on several features to improve your user experience:
- New Search Configuration UI: The Search tab now includes a new configuration UI, allowing you to customize how searches are performed.
- New Widget Builder Section: We have introduced a new Widget Builder section where you can save multiple configurations on your local machine, providing greater flexibility and convenience.
- Display TextBlock Type on Field Viewer: The field viewer now supports displaying TextBlock types. You can easily see OCR text, transcriptions, descriptions, or data coming from a table, enhancing data visibility and usability.