AuthToken data of an online service.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| Base | AuthTokenBase | No | AuthToken basic information. |
| Limits | Array of AuthTokenLimit | No | AuthToken throttling array. |
AuthToken basic information.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| Value | String | No | Token value. |
| Name | String | No | Token alias. |
| Description | String | No | Token description. |
| CreateTime | String | No | Token creation time. |
| Status | String | No | Token status. |
AuthToken throttling information.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| Strategy | String | No | Frequency limit policy. Valid values: PerMinute (frequency limit per minute) and PerDay (daily frequency limit). |
| Max | Integer | No | Upper limit. |
CBS storage configuration.
Used by actions: CreateTrainingTask.
| Name | Type | Required | Description |
|---|---|---|---|
| VolumeSizeInGB | Integer | Yes | Storage size. Note: This field may return null, indicating that no valid values can be obtained. |
CFS storage configurations.
Used by actions: CreateTrainingTask, DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| Id | String | Yes | CFS instance ID. |
| Path | String | Yes | Storage path. |
| MountType | String | No | Mounting type of CFS. Valid values: STORAGE and SOURCE, which respectively indicate the storage expansion mode and the data source mode. The default value is STORAGE.Note: This field may return null, indicating that no valid values can be obtained. |
| Protocol | String | No | Protocol. Valid values: NFS and TURBO.Note: This field may return null, indicating that no valid values can be obtained. |
Parameters for configuring CFSTurbo.
Used by actions: CreateTrainingTask.
| Name | Type | Required | Description |
|---|---|---|---|
| Id | String | No | CFSTurbo instance ID. Note: This field may return null, indicating that no valid values can be obtained. |
| Path | String | No | CFSTurbo path. Note: This field may return null, indicating that no valid values can be obtained. |
Code repository configuration.
Used by actions: CreateTrainingTask.
| Name | Type | Required | Description |
|---|---|---|---|
| Id | String | Yes | Code repository ID. |
| TargetPath | String | Yes | Target address for the code repository download. |
Container information.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| Name | String | Yes | Name.Note: This field may return null, indicating that no valid values can be obtained. |
| ContainerId | String | Yes | id Note: This field may return null, indicating that no valid values can be obtained. |
| Image | String | Yes | Image address.Note: This field may return null, indicating that no valid values can be obtained. |
| Status | ContainerStatus | Yes | Container status.Note: This field may return null, indicating that no valid values can be obtained. |
Container status.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| RestartCount | Integer | Yes | Number of restarts.Note: This field may return null, indicating that no valid values can be obtained. |
| State | String | Yes | Status.Note: This field may return null, indicating that no valid values can be obtained. |
| Ready | Boolean | Yes | Whether it is ready.Note: This field may return null, indicating that no valid values can be obtained. |
| Reason | String | Yes | Status reason.Note: This field may return null, indicating that no valid values can be obtained. |
| Message | String | Yes | Container error message.Note: This field may return null, indicating that no valid values can be obtained. |
COS path information.
Used by actions: CreateTrainingTask, DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| Bucket | String | Yes | Bucket.Note: This field may return null, indicating that no valid values can be obtained. |
| Region | String | Yes | Region.Note: This field may return null, indicating that no valid values can be obtained. |
| Paths | Array of String | Yes | Path list. Only one path is supported.Note: This field may return null, indicating that no valid values can be obtained. |
Scheduled scaling task.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| Schedule | String | Yes | Cron expression, which identifies the task execution time, and is accurate to minutes. |
| Name | String | No | Scheduled task name.Note: This field may return null, indicating that no valid values can be obtained. |
| TargetReplicas | Integer | No | Number of target instances.Note: This field may return null, indicating that no valid values can be obtained. |
| MinReplicas | Integer | No | Minimum target.Note: This field may return null, indicating that no valid values can be obtained. |
| MaxReplicas | Integer | No | Maximum target.Note: This field may return null, indicating that no valid values can be obtained. |
| ExcludeDates | Array of String | No | Exception periods, defined by Cron expressions, during which tasks are not executed. Up to 3 Cron expressions are supported.Note: This field may return null, indicating that no valid values can be obtained. |
Information about Pod calls involving ENIs across tenants.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| PrimaryIP | String | No | Pod IP address.Note: This field may return null, indicating that no valid values can be obtained. |
| Port | String | No | Pod port.Note: This field may return null, indicating that no valid values can be obtained. |
Data configuration.
Used by actions: CreateTrainingTask.
| Name | Type | Required | Description |
|---|---|---|---|
| MappingPath | String | No | Mapping path. |
| DataSourceUsage | String | No | Storage purpose. Valid values: BUILTIN_CODE, BUILTIN_DATA, BUILTIN_MODEL, USER_DATA, USER_CODE, USER_MODEL, OUTPUT, and OTHER. Note: This field may return null, indicating that no valid values can be obtained. |
| DataSourceType | String | No | DATASET, COS, CFS, CFSTurbo, GooseFSx, HDFS, and WEDATA_HDFS Note: This field may return null, indicating that no valid values can be obtained. |
| DataSetSource | DataSetConfig | No | Data from the data set. Note: This field may return null, indicating that no valid values can be obtained. |
| COSSource | CosPathInfo | No | Data from COS. Note: This field may return null, indicating that no valid values can be obtained. |
| CFSSource | CFSConfig | No | Data from CFS. Note: This field may return null, indicating that no valid values can be obtained. |
| HDFSSource | HDFSConfig | No | Data from HDFS. Note: This field may return null, indicating that no valid values can be obtained. |
| GooseFSSource | GooseFS | No | GooseFS data. Note: This field may return null, indicating that no valid values can be obtained. |
| CFSTurboSource | CFSTurbo | No | TurboFS data. Note: This field may return null, indicating that no valid values can be obtained. |
| LocalDiskSource | LocalDisk | No | Information from local disks. Note: This field may return null, indicating that no valid values can be obtained. |
| CBSSource | CBSConfig | No | CBS configuration information. Note: This field may return null, indicating that no valid values can be obtained. |
| HostPathSource | HostPath | No | Host path information. |
| PublicDataSource | PublicDataSourceFS | No |
Data set structure.
Used by actions: CreateTrainingTask.
| Name | Type | Required | Description |
|---|---|---|---|
| Id | String | Yes | Data set ID. |
Encoded startup command information.
Used by actions: CreateTrainingTask.
| Name | Type | Required | Description |
|---|---|---|---|
| StartCmdInfo | String | No | Startup command of the task, which is input in base64 format. Note that the complete input of {"StartCmd":"","PsStartCmd":"","WorkerStartCmd":""} is required for conversion. |
Environment variables.
Used by actions: CreateTrainingTask, DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| Name | String | No | Environment variable key.Note: This field may return null, indicating that no valid values can be obtained. |
| Value | String | No | Environment variable value.Note: This field may return null, indicating that no valid values can be obtained. |
Probe check action for execution commands.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| Command | Array of String | No | Execution command list. |
Used by actions: CreateTrainingTask.
| Name | Type | Required | Description |
|---|---|---|---|
| SSHConfig | SSHConfig | No | |
| ExposePortConfig | ExposePortConfig | No |
Exposed port information.
Used by actions: CreateTrainingTask.
| Name | Type | Required | Description |
|---|---|---|---|
| Enable | Boolean | No | |
| VpcId | String | No | |
| ClbId | String | No | |
| ClbHost | String | No |
Filter.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| Name | String | No | Filter field name. |
| Values | Array of String | No | Filter field values. |
| Negative | Boolean | No | Whether to enable reverse query. |
| Fuzzy | Boolean | No | Whether to enable fuzzy matching. |
GooseFS configuration parameters.
Used by actions: CreateTrainingTask.
| Name | Type | Required | Description |
|---|---|---|---|
| Id | String | No | GooseFS instance ID. Note: This field may return null, indicating that no valid values can be obtained. |
| Type | String | No | GooseFS type, including GooseFS and GooseFSx. Note: This field may return null, indicating that no valid values can be obtained. |
| Path | String | No | Path to mount the GooseFSx instance. Note: This field may return null, indicating that no valid values can be obtained. |
| NameSpace | String | No | GooseFS namespace. Note: This field may return null, indicating that no valid values can be obtained. |
GooseFSx configurations.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| Id | String | No | GooseFSx instance ID. |
| Path | String | No | Path to mount the GooseFSx instance. |
GPU details.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| Name | String | No | GPU card type. Enumeration values: V100, A100, T4.Note: This field may return null, indicating that no valid values can be obtained. |
| Value | Integer | No | GPU card quantity, in 1/100 cards. For example, 100 represents 1 card.Note: This field may return null, indicating that no valid values can be obtained. |
HDFS parameter configuration.
Used by actions: CreateTrainingTask.
| Name | Type | Required | Description |
|---|---|---|---|
| Id | String | Yes | Cluster instance ID, such as emr-xxxxxxxx. |
| Path | String | Yes | Path. |
HTTP GET action.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| Path | String | No | HTTP path. |
| Port | Integer | No | Called port. |
Health probe.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| LivenessProbe | Probe | No | Liveness probe. |
| ReadinessProbe | Probe | No | Readiness probe. |
| StartupProbe | Probe | No | Startup probe. |
HPA description.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| MinReplicas | Integer | Yes | Minimum number of instances.Note: This field may return null, indicating that no valid values can be obtained. |
| MaxReplicas | Integer | Yes | Maximum number of instances.Note: This field may return null, indicating that no valid values can be obtained. |
| HpaMetrics | Array of Option | Yes | Supported."gpu-util": GPU utilization; value range: 10-100. "cpu-util": CPU utilization; value range: 10-100. "memory-util": memory utilization; value range: 10-100. "service-qps": the QPS value of single instances; value range: 1-5000."concurrency-util": the number of concurrent requests of single instances. Value range: 1-100000.Note: This field may return null, indicating that no valid values can be obtained. |
| ScaleUpStabilizationWindowSeconds | Integer | No | Scale-out cooldown period, in seconds. |
| ScaleDownStabilizationWindowSeconds | Integer | No | Scale-in cooldown period, in seconds. |
Host path mounting configuration.
Used by actions: CreateTrainingTask.
| Name | Type | Required | Description |
|---|---|---|---|
| Path | String | No | Host path to be mounted. |
Image description information.
Used by actions: CreateTrainingTask, DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| ImageType | String | Yes | Image type. Valid values: TCR ( which indicates a Tencent Container Registry (TCR) image), CCR (which indicates a TCR Personal Edition image), PreSet (which indicates a platform preset image), and CUSTOM (which indicates a third-party custom image). |
| ImageUrl | String | Yes | Image address. |
| RegistryRegion | String | No | Region corresponding to the TCR image.Note: This field may return null, indicating that no valid values can be obtained. |
| RegistryId | String | No | Instance ID corresponding to the TCR image.Note: This field may return null, indicating that no valid values can be obtained. |
| AllowSaveAllContent | Boolean | No | Whether to allow exporting all content.Note: This field may return null, indicating that no valid values can be obtained. |
| ImageName | String | No | Image name.Note: This field may return null, indicating that no valid values can be obtained. |
| SupportDataPipeline | Boolean | No | Whether to support data generation.Note: This field may return null, indicating that no valid values can be obtained. |
| ImageSecret | ImageSecret | No |
Used by actions: CreateTrainingTask.
| Name | Type | Required | Description |
|---|---|---|---|
| KeyId | String | No | |
| Username | String | No | |
| Password | String | No | |
| SecretId | String | No |
Inference code information.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| CosPathInfo | CosPathInfo | Yes | Details of Cloud Object Storage (COS) where the inference code is located.Note: This field may return null, indicating that no valid values can be obtained. |
Local disk information.
Used by actions: CreateTrainingTask.
| Name | Type | Required | Description |
|---|---|---|---|
| InstanceId | String | Yes | Node ID. Note: This field may return null, indicating that no valid values can be obtained. |
| LocalPath | String | No | Local path. Note: This field may return null, indicating that no valid values can be obtained. |
Log configurations.
Used by actions: CreateTrainingTask, DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| LogsetId | String | Yes | Logs should be shipped to a Cloud Log Service (CLS) log set.Note: This field may return null, indicating that no valid values can be obtained. |
| TopicId | String | Yes | Logs should be shipped to a CLS topic.Note: This field may return null, indicating that no valid values can be obtained. |
Model description information.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| ModelVersionId | String | Yes | The model version ID is returned by the DescribeTrainingModelVersion API when querying the model.Enter the task ID of the Automated Machine Learning (AutoML) model. |
| ModelId | String | No | Model ID. |
| ModelName | String | No | Model name. |
| ModelVersion | String | No | Model version. |
| ModelSource | String | No | Model source. |
| CosPathInfo | CosPathInfo | No | COS path information. |
| GooseFSx | GooseFSx | No | GooseFSx configuration. This parameter takes effect if ModelSource is GooseFSx. Note: This field may return null, indicating that no valid values can be obtained. |
| AlgorithmFramework | String | No | Algorithm framework corresponding to the model (reserved field).Note: This field may return null, indicating that no valid values can be obtained. |
| ModelType | String | No | Default: NORMAL; accelerated model: ACCELERATE; automatic learning model: AUTO_ML.Note: This field may return null, indicating that no valid values can be obtained. |
| ModelFormat | String | No | Model format.Note: This field may return null, indicating that no valid values can be obtained. |
| IsPrivateModel | Boolean | No | Whether it is a private LLM.Note: This field may return null, indicating that no valid values can be obtained. |
| ModelCategory | String | No | Model category. Valid values: MultiModal (multi-modal) and LLM (text LLM). |
| PublicDataSource | PublicDataSourceFS | No | Data source configurations. |
Percentage or quantity.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| Type | String | No | Valid values: Num and Percent, which indicate quantity and percentage respectively. The default value is Num. |
| Value | Integer | No | Numeric value. |
Key-value pair.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| Name | String | Yes | Metric name. |
| Value | Integer | Yes | Metric value. |
Pod information display.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| Name | String | No | Pod name.Note: This field may return null, indicating that no valid values can be obtained. |
| Uid | String | No | Unique ID of the Pod.Note: This field may return null, indicating that no valid values can be obtained. |
| ChargeType | String | No | Service payment mode.Note: This field may return null, indicating that no valid values can be obtained. |
| Phase | String | No | Pod status.Note: This field may return null, indicating that no valid values can be obtained. |
| IP | String | No | Pod IP address.Note: This field may return null, indicating that no valid values can be obtained. |
| CreateTime | String | No | Pod creation time.Note: This field may return null, indicating that no valid values can be obtained. |
| ContainerInfos | Array of Container | No | Container list.Note: This field may return null, indicating that no valid values can be obtained. |
| CrossTenantENIInfo | CrossTenantENIInfo | No | Container calling information.Note: This field may return null, indicating that no valid values can be obtained. |
| Status | String | No | Instance status information. |
| StartScheduleTime | String | No | Instance scheduling start time. |
| Message | String | No | Supplemental instance status information. |
| NodeIP | String | No | Node IP address of the current instance. |
| NodeId | String | No | Node ID of the current instance. |
| ResourceGroupId | String | No | Resource group ID to which the instance belonged. |
| ResourceGroupName | String | No | Resource group name. |
| ResourceInfo | ResourceInfo | No | Resource usage information of the instance. |
Information about Pod access over SSH.
Used by actions: CreateTrainingTask.
| Name | Type | Required | Description |
|---|---|---|---|
| Host | String | No | IP address of the Pod. |
| Port | Integer | No | SSH port of the Pod. |
| LoginCommand | String | No | SSH access command. |
Probe structure information.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| ProbeAction | ProbeAction | No | Probe action. |
| InitialDelaySeconds | Integer | No | Delay in waiting for a service startup. |
| PeriodSeconds | Integer | No | Polling check interval. |
| TimeoutSeconds | Integer | No | Check timeout duration. |
| FailureThreshold | Integer | No | Number of acknowledged failed detections. |
| SuccessThreshold | Integer | No | Number of acknowledged successful detections. The default values for readiness, liveness, and startup statuses are 3, 1, and 1. |
Probe action.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| HTTPGet | HTTPGetAction | No | HTTP GET action. |
| Exec | ExecAction | No | Executes check command action. |
| TCPSocket | TCPSocketAction | No | TCP Socket check action. |
| ActionType | String | No | Probe type. The default value is HTTPGet. Valid values: HTTPGet, Exec, and TCPSocket. |
Public cloud data source structure.
Used by actions: CreateTrainingTask, DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| DataSourceId | String | No | Data source ID. |
| SubPath | String | No | Relative subpath to the data source. |
RDMA configuration.
Used by actions: CreateTrainingTask.
| Name | Type | Required | Description |
|---|---|---|---|
| Enable | Boolean | No | Whether to enable RDMA. Note: This field may return null, indicating that no valid values can be obtained. |
Resource configuration.
Used by actions: CreateTrainingTask.
| Name | Type | Required | Description |
|---|---|---|---|
| Role | String | Yes | Role. For example, PS, WORKER, DRIVER, and EXECUTOR. |
| Cpu | Integer | No | Number of CPU cores, which is required to be configured when resource groups are used. Unit: 1/1000, where 1000 represents 1 core. |
| Memory | Integer | No | Memory size, in MB. This parameter needs to be configured when resource groups are used. |
| GpuType | String | No | GPU card type, which is required to be configured when resource groups are used. |
| Gpu | Integer | No | Number of GPU cards, which is required to be configured when resource groups are used. Unit: 1/100, where 100 represents 1 card. |
| InstanceType | String | No | CVM instance specification ID. CVM instance specification (for postpaid billing). Valid values: TI.S.LARGE.POST: 4C8G TI.S.2XLARGE16.POST: 8C16G TI.S.2XLARGE32.POST: 8C32G TI.S.4XLARGE32.POST: 16C32G TI.S.4XLARGE64.POST: 16C64G TI.S.6XLARGE48.POST: 24C48G TI.S.6XLARGE96.POST: 24C96G TI.S.8XLARGE64.POST: 32C64G TI.S.8XLARGE128.POST : 32C128G TI.GN10.2XLARGE40.POST: 8C40G V1001 TI.GN10.5XLARGE80.POST: 18C80G V1002 TI.GN10.10XLARGE160.POST : 32C160G V1004 TI.GN10.20XLARGE320.POST : 72C320G V1008 TI.GN7.8XLARGE128.POST: 32C128G T41 TI.GN7.10XLARGE160.POST: 40C160G T42 TI.GN7.20XLARGE320.POST: 80C32 |
| InstanceNum | Integer | No | Number of compute nodes. |
| InstanceTypeAlias | String | No | CVM instance specification name. CVM instance specification (for postpaid billing). Valid values: 4C8G 8C16G 8C32G 16C32G 6C64G 24C48G 24C96G 32C64G 32C128G 8C40G V1001 8C80G V1002 32C160G V1004 72C320G V1008 32C128G T41 40C160G T42 80C32 |
| RDMAConfig | RDMAConfig | No | RDMA configuration. Note: This field may return null, indicating that no valid values can be obtained. |
Summarized information structure for the serviced resource group while an online service is provided.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Description |
|---|---|---|
| ResourceGroupId | String | Resource group ID. |
| ResourceGroupName | String | Resource group name. |
Resource information description.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| Cpu | Integer | Yes | Processor resource, in 1/1000 cores.Note: This field may return null, indicating that no valid values can be obtained. |
| Memory | Integer | Yes | Memory resource, in MB.Note: This field may return null, indicating that no valid values can be obtained. |
| Gpu | Integer | No | Number of GPU card resources, in 0.01 units of GpuType.Gpu=100 indicates the use of "1" GPU card. However, this "1" card could refer to a virtualized 1/4 card or a full physical card, depending on the instance type.Example 1: If the instance type includes 1 virtual GPU card, and each virtual GPU card corresponds to 1/4 of a physical T4 card, then GpuType=T4, Gpu=100, and RealGpu=25.Example 2: If the instance type includes 4 full GPU cards, and each card corresponds to 1 physical T4 card, then GpuType=T4, Gpu=400, and RealGpu=400.Note: This field may return null, indicating that no valid values can be obtained. |
| GpuType | String | No | GPU card model. Valid values: T4 and V100. It only displays the current GPU card model. If multiple types of cards are used simultaneously, see the value of RealGpuDetailSet.Note: This field may return null, indicating that no valid values can be obtained. |
| RealGpu | Integer | No | It is not required for creation or update operations. This field is used for display only.The actual GPU card resources for postpaid instances using fractional GPU cards. This value represents the total number of actual physical GPU cards consumed.RealGpu=100 indicates the consumption of 1 GPU card. Depending on the actual instance type, this may represent: 4 instances each using a 1/4 card, 2 instances each using a 1/2 card, or 1 instance using a full card. |
| RealGpuDetailSet | Array of GpuDetail | No | It is not required for creation or update operations. This field is used for display only. It involves detailed GPU usage information. |
| EnableRDMA | Boolean | No | Indicates whether to enable RDMA. Note: This field may return null, indicating that no valid values can be obtained. |
| RootDisk | Integer | No | |
| DataDisk | Integer | No |
Used by actions: CreateTrainingTask.
| Name | Type | Required | Description |
|---|---|---|---|
| SupplyType | String | No | |
| ClusterType | String | No |
Rolling update policy.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| MaxUnavailable | NumOrPercent | No | Maximum unavailability for rolling updates. |
| MaxSurge | NumOrPercent | No | Maximum number of new instances during rolling updates. |
Notebook SSH port configuration.
Used by actions: CreateTrainingTask.
| Name | Type | Required | Description |
|---|---|---|---|
| Enable | Boolean | No | Whether to enable SSH. Note: This field may return null, indicating that no valid values can be obtained. |
| PublicKey | String | No | Public key information. Note: This field may return null, indicating that no valid values can be obtained. |
| Port | Integer | No | Port number. Note: This field may return null, indicating that no valid values can be obtained. |
| LoginCommand | String | No | Login command. Note: This field may return null, indicating that no valid values can be obtained. |
| IsAddressChanged | Boolean | No | Whether to change the login address. Note: This field may return null, indicating that no valid values can be obtained. |
| PodSSHInfo | PodSSHInfo | No | Pod access information. Note: This field may return null, indicating that no valid values can be obtained. |
Scheduled transactions and actions.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| ScheduleStop | Boolean | No | Whether to stop the service on schedule. Valid values: true and false. If the value is true, ScheduleStopTime is required. If the value is false, ScheduleStopTime does not take effect. |
| ScheduleStopTime | String | No | Time to execute the scheduled stop. Format: "2022-01-26T19:46:22+08:00". |
Service scheduling policy configurations.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Description |
|---|---|---|
| CrossResourceGroupScheduling | Boolean | Whether to enable cross-resource-group scheduling. |
Online service description.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Description |
|---|---|---|
| ServiceGroupId | String | Service group ID. |
| ServiceId | String | Service ID. |
| ServiceGroupName | String | Service group name. |
| ServiceDescription | String | Service description.Note: This field may return null, indicating that no valid values can be obtained. |
| ServiceInfo | ServiceInfo | Service details.Note: This field may return null, indicating that no valid values can be obtained. |
| ClusterId | String | Cluster ID.Note: This field may return null, indicating that no valid values can be obtained. |
| Region | String | Region.Note: This field may return null, indicating that no valid values can be obtained. |
| Namespace | String | Namespace.Note: This field may return null, indicating that no valid values can be obtained. |
| ChargeType | String | Billing type.Note: This field may return null, indicating that no valid values can be obtained. |
| ResourceGroupId | String | Resource group ID for yearly/monthly subscription services. The value is null for pay-as-you-go services.Note: This field may return null, indicating that no valid values can be obtained. |
| ResourceGroupName | String | Resource group name corresponding to the yearly/monthly subscription service.Note: This field may return null, indicating that no valid values can be obtained. |
| Tags | Array of Tag | Tag of the service.Note: This field may return null, indicating that no valid values can be obtained. |
| IngressName | String | Name of the ingress where the service is located.Note: This field may return null, indicating that no valid values can be obtained. |
| CreatedBy | String | Creator.Note: This field may return null, indicating that no valid values can be obtained. |
| CreateTime | String | Creation time.Note: This field may return null, indicating that no valid values can be obtained. |
| UpdateTime | String | Update time.Note: This field may return null, indicating that no valid values can be obtained. |
| Uin | String | Root account.Note: This field may return null, indicating that no valid values can be obtained. |
| SubUin | String | Sub-account.Note: This field may return null, indicating that no valid values can be obtained. |
| AppId | Integer | app_id Note: This field may return null, indicating that no valid values can be obtained. |
| BusinessStatus | String | Operational status of the service.Note: This field may return null, indicating that no valid values can be obtained. |
| CreateFailedReason | String | Cause for service creation failure. The default value of this field is CREATE_SUCCEED upon successful creation.Note: This field may return null, indicating that no valid values can be obtained. |
| Status | String | Service status.CREATING: creating.CREATE_FAILED: creation failed.Normal: running.Stopped: stopped.Stopping: stopping.Abnormal: error.Pending: starting.Waiting: getting ready.Note: This field may return null, indicating that no valid values can be obtained. |
| BillingInfo | String | Billing information.Note: This field may return null, indicating that no valid values can be obtained. |
| Weight | Integer | Model weight.Note: This field may return null, indicating that no valid values can be obtained. |
| CreateSource | String | Creation source of the service.AUTO_ML: comes from one-click release of automatic learning.DEFAULT: other sources.Note: This field may return null, indicating that no valid values can be obtained. |
| Version | String | Version number.Note: This field may return null, indicating that no valid values can be obtained. |
| LatestVersion | String | The latest version number of services under a service group.Note: This field may return null, indicating that no valid values can be obtained. |
| ResourceGroupSWType | String | Resource group category. Valid values: NORMAL (hosting) and SW (half-hosting).Note: This field may return null, indicating that no valid values can be obtained. |
| ArchiveStatus | String | Archiving status of the service. Valid values: Waiting (pending archiving) and Archived (archived).Note: This field may return null, indicating that no valid values can be obtained. |
| DeployType | String | Deployment type of the service. Valid values: STANDARD (standard deployment) and DIST (multi-machine distributed deployment). The default value is STANDARD.Note: This field may return null, indicating that no valid values can be obtained. |
| InstancePerReplicas | String | Number of instances per replica. This parameter is valid only when the deployment type is DIST. Default value: 1.Note: This field may return null, indicating that no valid values can be obtained. |
| MonitorSource | String | Source for monitoring queries.Enumeration value. May differ from CreateSource in certain scenarios. This field is designed to be compatible. |
| SubUinName | String | Sub-account name of the service creator. |
| SchedulingPolicy | SchedulingPolicy | Scheduling policy of the service. |
| ExternalResourceGroups | Array of ResourceGroupInfo | External resource group information, indicating which resources are borrowed from resource groups. |
Service shared Elastic Network Interface (ENI) settings.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| EnableEIP | Boolean | No | Whether to enable access from the TI-ONE private network to external resources.Note: This field may return null, indicating that no valid values can be obtained. |
| VpcId | String | No | User VPC ID.Note: This field may return null, indicating that no valid values can be obtained. |
| SubnetId | String | No | User subnet ID.Note: This field may return null, indicating that no valid values can be obtained. |
Information of a service group for an online service.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Description |
|---|---|---|
| ServiceGroupId | String | Service group ID. |
| ServiceGroupName | String | Service group name. |
| CreatedBy | String | Creator. |
| CreateTime | String | Creation time. |
| UpdateTime | String | Update time. |
| Uin | String | Root account. |
| ServiceCount | Integer | Total number of services in the service group.Note: This field may return null, indicating that no valid values can be obtained. |
| RunningServiceCount | Integer | Number of running services in the service group.Note: This field may return null, indicating that no valid values can be obtained. |
| Services | Array of Service | Service description.Note: This field may return null, indicating that no valid values can be obtained. |
| Status | String | Service group status, which aligns with service status.CREATING: creating.CREATE_FAILED: creation failed.Normal: running.Stopped: stopped.Stopping: stopping.Abnormal: error.Pending: starting.Waiting: getting ready.Note: This field may return null, indicating that no valid values can be obtained. |
| Tags | Array of Tag | Service group tags.Note: This field may return null, indicating that no valid values can be obtained. |
| LatestVersion | String | The latest version in the service group.Note: This field may return null, indicating that no valid values can be obtained. |
| BusinessStatus | String | Operational status of the service.CREATING: creating.CREATE_FAILED: creation failed.ARREARS_STOP: service suspended due to overdue payments.BILLING: billing.WHITELIST_USING: allowlist feature is in trial.WHITELIST_STOP: insufficient allowlist quota.Note: This field may return null, indicating that no valid values can be obtained. |
| BillingInfo | String | Billing information of the service.Note: This field may return null, indicating that no valid values can be obtained. |
| CreateSource | String | Creation source of the service.Note: This field may return null, indicating that no valid values can be obtained. |
| WeightUpdateStatus | String | Weight update status of the service group.UPDATING: updating.UPDATED: updated successfully.UPDATE FAILED: failed to update.Note: This field may return null, indicating that no valid values can be obtained. |
| ReplicasCount | Integer | Number of running Pods in the service group.Note: This field may return null, indicating that no valid values can be obtained. |
| AvailableReplicasCount | Integer | Expected number of Pods under the service group.Note: This field may return null, indicating that no valid values can be obtained. |
| SubUin | String | Service group's subuin. |
| AppId | Integer | Service group's app_id. |
| AuthorizationEnable | Boolean | Whether to enable authentication. |
| AuthTokens | Array of AuthToken | List of throttling authentication tokens. |
| MonitorSource | String | Field for monitoring creation source. |
| SubUinName | String | Nickname of the sub-user. |
Information of the inference service in the cluster.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| Replicas | Integer | Yes | Expected number of running Pods. The instance is 0 when the stop status is reached.Corresponding relationships under different billing and scaling modes are as follows.PREPAID and POSTPAID_BY_HOUR:Corresponding number of instances in the manual scaling mode.Corresponding number of instances based on the default time-based policy in the auto-scaling mode.HYBRID_PAID: Corresponding number of instances for postpaid instances in the manual scaling mode.Corresponding number of instances under the default time-based policy for postpaid instances in the auto-scaling mode.Note: This field may return null, indicating that no valid values can be obtained. |
| ImageInfo | ImageInfo | Yes | Image information.Note: This field may return null, indicating that no valid values can be obtained. |
| Env | Array of EnvVar | Yes | Environment variables.Note: This field may return null, indicating that no valid values can be obtained. |
| Resources | ResourceInfo | Yes | Resource information.Note: This field may return null, indicating that no valid values can be obtained. |
| InstanceType | String | Yes | Type specifications corresponding to the postpaid instance.Note: This field may return null, indicating that no valid values can be obtained. |
| ModelInfo | ModelInfo | Yes | Model information.Note: This field may return null, indicating that no valid values can be obtained. |
| LogEnable | Boolean | Yes | Whether to enable logs.Note: This field may return null, indicating that no valid values can be obtained. |
| LogConfig | LogConfig | Yes | Log configurations.Note: This field may return null, indicating that no valid values can be obtained. |
| AuthorizationEnable | Boolean | Yes | Whether to enable authentication.Note: This field may return null, indicating that no valid values can be obtained. |
| HorizontalPodAutoscaler | HorizontalPodAutoscaler | Yes | HPA configurations.Note: This field may return null, indicating that no valid values can be obtained. |
| Status | WorkloadStatus | Yes | Description of the service status.Note: This field may return null, indicating that no valid values can be obtained. |
| Weight | Integer | Yes | Weight.Note: This field may return null, indicating that no valid values can be obtained. |
| ResourceTotal | ResourceInfo | Yes | Total resources.Note: This field may return null, indicating that no valid values can be obtained. |
| OldReplicas | Integer | Yes | Number of historical instances.Note: This field may return null, indicating that no valid values can be obtained. |
| HybridBillingPrepaidReplicas | Integer | Yes | This parameter is valid when the billing mode is HYBRID_PAID, and is used to identify the number of prepaid instances in the hybrid billing mode. The default value is 1 if this parameter is left unspecified.Note: This field may return null, indicating that no valid values can be obtained. |
| OldHybridBillingPrepaidReplicas | Integer | Yes | Number of instances during the historical HYBRID_PAID period. The user restores services.Note: This field may return null, indicating that no valid values can be obtained. |
| ModelHotUpdateEnable | Boolean | Yes | Whether to enable hot update for the model. By default, hot update is disabled.Note: This field may return null, indicating that no valid values can be obtained. |
| InstanceAlias | String | No | Service specification alias. |
| ScaleMode | String | No | Instance quantity adjusting mode. Defaults to manual.Supported valid values: AUTO (automatic), MANUAL (manual).Note: This field may return null, indicating that no valid values can be obtained. |
| CronScaleJobs | Array of CronScaleJob | No | Scheduled scaling task.Note: This field may return null, indicating that no valid values can be obtained. |
| ScaleStrategy | String | No | Scheduled scaling policy.Note: This field may return null, indicating that no valid values can be obtained. |
| ScheduledAction | ScheduledAction | No | Configurations of the scheduled stop.Note: This field may return null, indicating that no valid values can be obtained. |
| PodInfos | Array of Pod | No | Pod list information.Note: This field may return null, indicating that no valid values can be obtained. |
| ServiceLimit | ServiceLimit | No | Configurations related to speed limit and throttling of services.Note: This field may return null, indicating that no valid values can be obtained. |
| ModelTurboEnable | Boolean | No | Whether to enable model acceleration, which is only valid for models in the StableDiffusion (dynamic acceleration) format.Note: This field may return null, indicating that no valid values can be obtained. |
| VolumeMount | VolumeMount | No | Mounting.Note: This field may return null, indicating that no valid values can be obtained. |
| InferCodeInfo | InferCodeInfo | No | Inference code information.Note: This field may return null, indicating that no valid values can be obtained. |
| Command | String | No | Service startup command.Note: This field may return null, indicating that no valid values can be obtained. |
| ServiceEIP | ServiceEIP | No | Settings of enabling the TI-ONE private network to access external resources.Note: This field may return null, indicating that no valid values can be obtained. |
| ServicePort | Integer | No | Service port, with the default value of 8501.Note: This field may return null, indicating that no valid values can be obtained. |
| TerminationGracePeriodSeconds | Integer | No | Graceful exit time limit of the service, in seconds. Default value: 30. Minimum value: 1. |
| PreStopCommand | Array of String | No | Command executed before the service instance stops. The instance ends after the command execution is completed or after the execution time exceeds the graceful exit time limit. |
| GrpcEnable | Boolean | No | Whether to enable the gRPC port. |
| HealthProbe | HealthProbe | No | Health probe. |
| RollingUpdate | RollingUpdate | No | Rolling update configurations. |
| InstancePerReplicas | Integer | No | Number of instances per replica. This parameter is valid only when the deployment type is DIST or ROLE. Default value: 1. |
| VolumeMounts | Array of VolumeMount | No | Batch data disk mounting configurations. |
Configurations related to throttling and speed limit of services.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| EnableInstanceRpsLimit | Boolean | No | Whether to enable throttling and speed limit at the instance level. Valid values: true and false. If the value is true, InstanceRpsLimit is required. If the value is false, InstanceRpsLimit does not take effect. |
| InstanceRpsLimit | Integer | No | Speed limit for the requests per second (RPS) of each service instance. 0 indicates no throttling. |
| EnableInstanceReqLimit | Boolean | No | Whether to enable the maximum concurrency quantity limit for a single instance. Valid values: true and false. If the value is true, InstanceReqLimit is required. If the value is false, InstanceReqLimit does not take effect. |
| InstanceReqLimit | Integer | No | Maximum concurrency for each service instance. |
Startup command information.
Used by actions: CreateTrainingTask.
| Name | Type | Required | Description |
|---|---|---|---|
| StartCmd | String | No | Startup command. |
| PsStartCmd | String | No | Startup command for ps nodes. |
| WorkerStartCmd | String | No | Startup command for Worker nodes. |
Instance status.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| Message | String | Yes | Information.Note: This field may return null, indicating that no valid values can be obtained. |
| Reason | String | Yes | Reason.Note: This field may return null, indicating that no valid values can be obtained. |
| Status | String | Yes | Status of the condition, True, False or Unknown.Note: This field may return null, indicating that no valid values can be obtained. |
| Type | String | Yes | Type.Note: This field may return null, indicating that no valid values can be obtained. |
| LastTransitionTime | String | Yes | Last update time.Note: This field may return null, indicating that no valid values can be obtained. |
| LastUpdateTime | String | No | Last update time.Note: This field may return null, indicating that no valid values can be obtained. |
Check action of a TCP Socket health probe.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| Port | Integer | No | Called port. |
Tencent Cloud tag description.
Used by actions: CreateTrainingTask, DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| TagKey | String | Yes | Tag key.Note: This field may return null, indicating that no valid values can be obtained. |
| TagValue | String | Yes | Tag value.Note: This field may return null, indicating that no valid values can be obtained. |
Tag filtering parameters.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| TagKey | String | No | Tag key. |
| TagValues | Array of String | No | Multiple tag values. |
Used by actions: CreateTrainingTask.
| Name | Type | Required | Description |
|---|---|---|---|
| EnableHangMonitor | Boolean | No | |
| HangMonitorNodes | Array of String | No | |
| LogHangTimeoutInMinute | Integer | No |
External mounting information.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| CFSConfig | CFSConfig | No | Cloud File Storage (CFS) configuration information. |
| VolumeSourceType | String | No | Mounting source type. Valid values: CFS and COS. The default value is CFS. |
| MountPath | String | No | Mounting path in the custom container.Note: This field may return null, indicating that no valid values can be obtained. |
Workload status.
Used by actions: DescribeModelServiceGroups.
| Name | Type | Required | Description |
|---|---|---|---|
| Replicas | Integer | Yes | Number of current instances. |
| UpdatedReplicas | Integer | Yes | Number of updated instances. |
| ReadyReplicas | Integer | Yes | Number of ready instances. |
| AvailableReplicas | Integer | Yes | Number of available instances. |
| UnavailableReplicas | Integer | Yes | Number of unavailable instances. |
| Status | String | Yes | Normal: running.Abnormal: service abnormalities, such as container startup failure.Waiting: service waiting, such as container image pulling.Stopped: stopped.Pending: starting.Stopping: stopping. |
| Conditions | Array of StatefulSetCondition | No | Status information of workload history. |
| Reason | String | No | Display the reason when the status is abnormal.Note: This field may return null, indicating that no valid values can be obtained. |
Esta página foi útil?
Você também pode entrar em contato com a Equipe de vendas ou Enviar um tíquete em caso de ajuda.
comentários