Kong AI Gateway Integrations

Amazon Bedrock serves as a robust platform that simplifies the process of creating and scaling generative AI applications by providing access to a wide array of advanced foundation models (FMs) from leading AI firms like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon itself. Through a streamlined API, developers can delve into these models, tailor them using techniques such as fine-tuning and Retrieval Augmented Generation (RAG), and construct agents capable of interacting with various corporate systems and data repositories. As a serverless option, Amazon Bedrock alleviates the burdens associated with managing infrastructure, allowing for the seamless integration of generative AI features into applications while emphasizing security, privacy, and ethical AI standards. This platform not only accelerates innovation for developers but also significantly enhances the functionality of their applications, contributing to a more vibrant and evolving technology landscape. Moreover, the flexible nature of Bedrock encourages collaboration and experimentation, allowing teams to push the boundaries of what generative AI can achieve.

OpenAI is committed to ensuring that artificial general intelligence (AGI)—characterized by its ability to perform most tasks that are economically important with a level of autonomy that surpasses human capabilities—benefits all of humanity. Our primary goal is to create AGI that is both safe and beneficial; however, we also view our mission as a success if we empower others to reach this same objective. You can take advantage of our API for numerous language-based functions, such as semantic search, summarization, sentiment analysis, content generation, translation, and much more, all achievable with just a few examples or a clear instruction in English. A simple integration gives you access to our ever-evolving AI technology, enabling you to test the API's features through these sample completions and uncover a wide array of potential uses. As you explore, you may find innovative ways to harness this technology for your projects or business needs.

Gemini, a cutting-edge AI chatbot developed by Google, is designed to enhance both creativity and productivity through dynamic, natural language conversations. It is accessible on web and mobile devices, seamlessly integrating with various Google applications such as Docs, Drive, and Gmail, which empowers users to generate content, summarize information, and manage tasks more efficiently. Thanks to its multimodal capabilities, Gemini can interpret and generate different types of data, including text, images, and audio, allowing it to provide comprehensive assistance in a wide array of situations. As it learns from interactions with users, Gemini tailors its responses to offer personalized and context-aware support, addressing a variety of user needs. This level of adaptability not only ensures responsive assistance but also allows Gemini to grow and evolve alongside its users, establishing itself as an indispensable resource for anyone aiming to improve their productivity and creativity. Furthermore, its unique ability to engage in meaningful dialogues makes it an innovative companion in both professional and personal endeavors.

Mistral AI is recognized as a pioneering startup in the field of artificial intelligence, with a particular emphasis on open-source generative technologies. The company offers a wide range of customizable, enterprise-grade AI solutions that can be deployed across multiple environments, including on-premises, cloud, edge, and individual devices. Notable among their offerings are "Le Chat," a multilingual AI assistant designed to enhance productivity in both personal and business contexts, and "La Plateforme," a resource for developers that streamlines the creation and implementation of AI-powered applications. Mistral AI's unwavering dedication to transparency and innovative practices has enabled it to carve out a significant niche as an independent AI laboratory, where it plays an active role in the evolution of open-source AI while also influencing relevant policy conversations. By championing the development of an open AI ecosystem, Mistral AI not only contributes to technological advancements but also positions itself as a leading voice within the industry, shaping the future of artificial intelligence. This commitment to fostering collaboration and openness within the AI community further solidifies its reputation as a forward-thinking organization.

Cohere is a powerful enterprise AI platform that enables developers and organizations to build sophisticated applications using language technologies. By prioritizing large language models (LLMs), Cohere delivers cutting-edge solutions for a variety of tasks, including text generation, summarization, and advanced semantic search functions. The platform includes the highly efficient Command family, designed to excel in language-related tasks, as well as Aya Expanse, which provides multilingual support for 23 different languages. With a strong emphasis on security and flexibility, Cohere allows for deployment across major cloud providers, private cloud systems, or on-premises setups to meet diverse enterprise needs. The company collaborates with significant industry leaders such as Oracle and Salesforce, aiming to integrate generative AI into business applications, thereby improving automation and enhancing customer interactions. Additionally, Cohere For AI, the company’s dedicated research lab, focuses on advancing machine learning through open-source projects and nurturing a collaborative global research environment. This ongoing commitment to innovation not only enhances their technological capabilities but also plays a vital role in shaping the future of the AI landscape, ultimately benefiting various sectors and industries.

Claude exemplifies an advanced AI language model designed to comprehend and generate text that closely mirrors human communication. Anthropic is an institution focused on the safety and research of artificial intelligence, striving to create AI systems that are reliable, understandable, and controllable. Although modern large-scale AI systems bring significant benefits, they also introduce challenges like unpredictability and opacity; therefore, our aim is to address these issues head-on. At present, our main focus is on progressing research to effectively confront these challenges; however, we foresee a wealth of opportunities in the future where our initiatives could provide both commercial success and societal improvements. As we forge ahead, we remain dedicated to enhancing the safety, functionality, and overall user experience of AI technologies, ensuring they serve humanity's best interests.

Utilizing a comprehensive set of observability tools enables you to thoroughly assess, test, and deploy LLM applications throughout both development and production phases. You can efficiently log traces and spans, while also defining and computing evaluation metrics to gauge performance. Scoring LLM outputs and comparing the efficiencies of different app versions becomes a seamless process. Furthermore, you have the capability to document, categorize, locate, and understand each action your LLM application undertakes to produce a result. For deeper analysis, you can manually annotate and juxtapose LLM results within a table. Both development and production logging are essential, and you can conduct experiments using various prompts, measuring them against a curated test collection. The flexibility to select and implement preconfigured evaluation metrics, or even develop custom ones through our SDK library, is another significant advantage. In addition, the built-in LLM judges are invaluable for addressing intricate challenges like hallucination detection, factual accuracy, and content moderation. The Opik LLM unit tests, designed with PyTest, ensure that you maintain robust performance baselines. In essence, building extensive test suites for each deployment allows for a thorough evaluation of your entire LLM pipeline, fostering continuous improvement and reliability. This level of scrutiny ultimately enhances the overall quality and trustworthiness of your LLM applications.

Weaviate is an open-source vector database designed to help users efficiently manage data objects and vector embeddings generated from their preferred machine learning models, with the capability to scale seamlessly to handle billions of items. Users have the option to import their own vectors or make use of the provided vectorization modules, allowing for the indexing of extensive data sets that facilitate effective searching. By incorporating a variety of search techniques, including both keyword-focused and vector-based methods, Weaviate delivers an advanced search experience. Integrating large language models like GPT-3 can significantly improve search results, paving the way for next-generation search functionalities. In addition to its impressive search features, Weaviate's sophisticated vector database enables a wide range of innovative applications. Users can perform swift pure vector similarity searches across both raw vectors and data objects, even with filters in place to refine results. The ability to combine keyword searches with vector methods ensures optimal outcomes, while the integration of generative models with their data empowers users to undertake complex tasks such as engaging in Q&A sessions over their datasets. This capability not only enhances the user's search experience but also opens up new avenues for creativity in application development, making Weaviate a versatile tool in the realm of data management and search technology. Ultimately, Weaviate stands out as a platform that not only improves search functionalities but also fosters innovation in how applications are built and utilized.

Vespa is designed for Big Data and AI, operating seamlessly online with unmatched efficiency, regardless of scale. It serves as a comprehensive search engine and vector database, enabling vector search (ANN), lexical search, and structured data queries all within a single request. The platform incorporates integrated machine-learning model inference, allowing users to leverage AI for real-time data interpretation. Developers often utilize Vespa to create recommendation systems that combine swift vector search capabilities with filtering and machine-learning model assessments for the items. To effectively build robust online applications that merge data with AI, it's essential to have more than just isolated solutions; you require a cohesive platform that unifies data processing and computing to ensure genuine scalability and reliability, while also preserving your innovative freedom—something that only Vespa accomplishes. With Vespa's established ability to scale and maintain high availability, it empowers users to develop search applications that are not just production-ready but also customizable to fit a wide array of features and requirements. This flexibility and power make Vespa an invaluable tool in the ever-evolving landscape of data-driven applications.

The Kong Konnect Enterprise Service Connectivity Platform facilitates seamless information flow within an organization by connecting various services. Built upon the reliable foundation of Kong, this platform enables users to efficiently manage APIs and microservices in both hybrid and multi-cloud environments. By leveraging Kong Konnect Enterprise, businesses can proactively detect and address potential threats and anomalies, while also enhancing visibility throughout their operations. This innovative platform empowers users to exert control over their services and applications effectively. Additionally, Kong Konnect Enterprise is recognized for its exceptional low latency and high scalability, ensuring optimal performance of your services. Its lightweight, open-source architecture further enhances the ability to fine-tune performance, making it a versatile solution for services, irrespective of their deployment location. Ultimately, Kong Konnect Enterprise serves as a powerful tool for organizations striving for operational excellence and agility.

Enterprise search, observability, and security can all be managed through cloud-based solutions. Gain effortless access to your data, extract meaningful insights, and protect your technological resources whether you are using Amazon Web Services, Google Cloud, or Microsoft Azure. We handle all the maintenance, enabling you to focus on generating insights that propel your business forward. The configuration and deployment processes are designed to be completely hassle-free. With easy scaling options, customizable plugins, and a framework specifically designed for log and time series data, the opportunities are vast. You can explore the comprehensive set of Elastic features, such as machine learning, Canvas, APM, index lifecycle management, Elastic App Search, and Elastic Workplace Search, all available exclusively on our platform. Logging and metrics are just the starting point; integrate your diverse data sources to confront security issues, improve observability, and achieve other critical operational goals. Furthermore, our platform equips you with the tools to make informed, data-driven decisions with speed and precision, ultimately leading to a more agile business environment. Experience the power of unifying your data today to unlock new avenues for growth and innovation.

Vertex AI Notebooks is a versatile, enterprise-ready solution for managing the entire machine learning lifecycle. Designed for scalability and ease of use, it allows users to interactively explore data, prototype ML models, and implement end-to-end workflows. By integrating with Google Cloud’s full ecosystem, including BigQuery and Dataproc, Vertex AI Notebooks simplifies data access and accelerates model development. The platform offers support for both Colab Enterprise and Vertex AI Workbench, providing secure, serverless environments optimized for enterprise use. It also enables seamless collaboration across teams with shared notebooks, and offers automated infrastructure management to reduce overhead. With built-in MLOps capabilities, Vertex AI Notebooks makes it easier to deploy, manage, and monitor models at scale, ensuring efficient and consistent results across machine learning projects.

Gemini Enterprise is a comprehensive AI solution from Google Cloud that aims to utilize the extensive capabilities of Google's advanced AI models, tools for agent creation, and enterprise-level data access, all integrated seamlessly into everyday operations. This cutting-edge platform includes a unified chat interface that enables employees to interact effectively with internal documents, applications, multiple data sources, and customized AI agents. The core of Gemini Enterprise is built upon six critical components: the Gemini suite of large multimodal models, an agent orchestration workbench formerly known as Google Agentspace, pre-built starter agents, robust data integration connectors for business systems, comprehensive security and governance measures, and a collaborative partner ecosystem for tailored integrations. Designed for scalability across different departments and organizations, it allows users to create no-code or low-code agents that can automate a variety of tasks, including research synthesis, customer service interactions, code support, and contract evaluation while remaining compliant with corporate regulations. In addition to streamlining operations, the platform also aims to boost productivity and inspire innovation across businesses, making it easier for users to take advantage of advanced AI technologies. Ultimately, Gemini Enterprise represents a significant step forward in the integration of AI into business processes, paving the way for a new era of efficiency and creativity in the workplace.

We provide an advanced HelpDesk solution designed to enhance your management processes and boost your team's productivity while improving support efficiency. Customers will benefit from the flexibility of submitting tickets across various devices, ensuring a more convenient experience. You gain greater oversight in configuring your customers' Service Level Agreements (SLA). Our inventory management application allows for comprehensive monitoring and control of your customers' entire equipment portfolio. By utilizing intelligent and automated inventory management, you can significantly enhance the productivity of your technical support staff. Elevate your customer relationship management! Stay informed with alerts on critical machine features through your personalized dashboard. Our platform offers automation, streamlined workflows, and ticket triggers to simplify processes. Features such as a Password Vault, satisfaction surveys, and ticket scheduling help manage interactions effectively. You can track customer interactions, explore the service catalog, follow up on tickets, conduct ticket conferences, and utilize an advanced dashboard for insights. With these tools, improving your service delivery has never been easier.

The AI Knowledge Platform offers a streamlined approach to developing high-performance vector search applications through its Pinecone Database, Inference, and Assistant. This fully managed and user-friendly database provides effortless scalability while eliminating infrastructure challenges. After creating vector embeddings, users can efficiently search and manage them within Pinecone, enabling semantic searches, recommendation systems, and other applications that depend on precise information retrieval. Even when dealing with billions of items, the platform ensures ultra-low query latency, delivering an exceptional user experience. Users can easily add, modify, or remove data with live index updates, ensuring immediate availability of their data. For enhanced relevance and speed, users can integrate vector search with metadata filters. Moreover, the API simplifies the process of launching, utilizing, and scaling vector search services while ensuring smooth and secure operation. This makes it an ideal choice for developers seeking to harness the power of advanced search capabilities.

Qdrant operates as an advanced vector similarity engine and database, providing an API service that allows users to locate the nearest high-dimensional vectors efficiently. By leveraging Qdrant, individuals can convert embeddings or neural network encoders into robust applications aimed at matching, searching, recommending, and much more. It also includes an OpenAPI v3 specification, which streamlines the creation of client libraries across nearly all programming languages, and it features pre-built clients for Python and other languages, equipped with additional functionalities. A key highlight of Qdrant is its unique custom version of the HNSW algorithm for Approximate Nearest Neighbor Search, which ensures rapid search capabilities while permitting the use of search filters without compromising result quality. Additionally, Qdrant enables the attachment of extra payload data to vectors, allowing not just storage but also filtration of search results based on the contained payload values. This functionality significantly boosts the flexibility of search operations, proving essential for developers and data scientists. Its capacity to handle complex data queries further cements Qdrant's status as a powerful resource in the realm of data management.

Microsoft Foundry Agent Service enables organizations to create, manage, and scale AI agents that automate complex, distributed processes with enterprise-grade reliability. Developers can design multi-agent systems using custom code or open frameworks like the Microsoft Agent Framework and LangGraph, then deploy them with built-in hosting and orchestration. The platform integrates natively with Azure Logic Apps, providing access to more than 1,400 connectors for building end-to-end automation across business systems. Agents can securely interact with APIs, tools, and proprietary data via Model Context Protocol, giving them the context needed to produce accurate, grounded results. With built-in memory and organizational context, agents can maintain continuity across interactions and deliver more personalized assistance. Foundry Agent Service includes comprehensive governance features—such as Entra Agent ID, audit logs, observability dashboards, and safety guardrails—that give enterprises complete oversight. Developers can monitor cost, performance, and quality in real time, ensuring scalable, predictable deployments. One-click publishing to Microsoft Teams and Microsoft 365 Copilot makes it easy for employees to use agents where they already work. Backed by Azure’s security, global infrastructure, and more than 100 compliance certifications, the platform supports mission-critical use cases across regulated industries. Overall, Foundry Agent Service transforms AI from isolated experiments into fully governed, production-grade automation across the enterprise.

Llama, a leading-edge foundational large language model developed by Meta AI, is designed to assist researchers in expanding the frontiers of artificial intelligence research. By offering streamlined yet powerful models like Llama, even those with limited resources can access advanced tools, thereby enhancing inclusivity in this fast-paced and ever-evolving field. The development of more compact foundational models, such as Llama, proves beneficial in the realm of large language models since they require considerably less computational power and resources, which allows for the exploration of novel approaches, validation of existing studies, and examination of potential new applications. These models harness vast amounts of unlabeled data, rendering them particularly effective for fine-tuning across diverse tasks. We are introducing Llama in various sizes, including 7B, 13B, 33B, and 65B parameters, each supported by a comprehensive model card that details our development methodology while maintaining our dedication to Responsible AI practices. By providing these resources, we seek to empower a wider array of researchers to actively participate in and drive forward the developments in the field of AI. Ultimately, our goal is to foster an environment where innovation thrives and collaboration flourishes.