Skip to content
Implementation, Customization, Security & Ecosystem
Product Assessment - Part 2
Core Focus Area
Sub-Focus Area
Question
Example Answer
Cost Impact
Level of Capability
Initial Setup & Integration
7
Deployment Architecture
Does the co-pilot have a streamlined model for the agent to communicate with the model server through the customer firewall efficiently and securely?
Eg. The co-pilot software leverages an API gateway to streamline traffic through a trusted FQDN & IP range from the browser client, through the customer firewall which can be easily allow listed.
Security & Compliance Costs
Performance & Monitoring Costs
Integration Costs
Infrastructure Costs
Local Installation & Distribution
Does the co-pilot software have an efficient mechanism of distributing / installing the co-pilot on end user browsers / work stations?
Eg. The co-pilot software is integrated into Chrome as a plug-in that can be distributed via a central web app and installed on individual user machines.
Integration Costs
Infrastructure Costs
Deployment & Testing Costs
Performance & Monitoring Costs
Integration with Customer Business Systems
Does the co-pilot facilitate easy integration with existing customer databases and subsequent data transformations for both API and non-API driven systems?
Eg. The co-pilot has a connector workflow to drag and drop configurable integrations from customer systems into a workflow based creator wherein a user can define data points that need to be referenced, along with transformations needed for RAG.
Data Acquisition, Storage and Processing Costs
Integration Costs
Infrastructure Costs
Interoperability
Depending on the deployment architecture, Does the co-pilot support multiple browsers and operating systems?
Eg. The co-pilot supports browsers such as Firefox and Microsoft Edge, beyond Google Chrome. OR The co-pilot agent can run on Windows XP or higher, as well as on Mac.
Enablement & Training Costs
Integration Costs
Private Cloud / On-Premise / Hybrid Support
Does the co-pilot offer secure private cloud deployments, or hybrid deployments to interface with on premise / privately hosted source data?
Eg. The co-pilot offers on premise connectors to privately hosted DB instances, as well as systems such as SAP Hana.
Data Acquisition, Storage and Processing Costs
Data Labelling Costs
Model Development Costs
Deployment & Testing Costs
Infrastructure Costs
Integration Costs
User Management
Does the co-pilot offer a secure user management mechanism that can integrate with customer’s identity systems via SSO?
Eg. The co-pilot software offers integration with Okta, PingFed and AFS for Single-Sign-On, and also offers a manual user management mechanism.
Security & Compliance Costs
Integration Costs
Licensing
Does the co-pilot offer a flexible licensing pool, wherein licensing can be switched between multiple users?
Eg. The co-pilot offers a floating licensing model that allows admins to switch licenses between systems, users and workstations.
Enablement & Training Costs
Licensing Costs
Configuration & Change Management
5
Input & Output Formats
Does the co-pilot provide an easy way to tweak input and output formats?
Eg. A user can tweak the input format to accomodate for questions and documents that an end customer can upload. From an output standpoint, a user can define whether the co-pilot generates a JSON, XML or CSV output.
Enablement & Training Costs
Integration Costs
Additional Configuration Costs
Fine Tuning via human-in-the-loop
Does the co-pilot provide mechanisms for users to fine tune underlying models with their own data, through ad-hoc approaches as well as via human in the loop?
Eg. The document understanding co-pilot provides users the capability to upload any new invoices received in the last month. Additionally, the invoice processing review step occasionally presents values that need human review along with 3 possible outcomes, for the user to select from, or manually enter within NetSuite.
Model Development Costs
Data Labelling Costs
Deployment & Testing Costs
Enablement & Training Costs
Infrastructure Costs
Data Acquisition, Storage and Processing Costs
Additional Configuration Costs
Type of Costs
Want to print your doc?
This is not the way.
This is not the way.
Try clicking the ··· in the right corner or using a keyboard shortcut (
CtrlP
) instead.