Data Ingestion
Raw
Databases
List databases
- RawDatabasesAPI.list(limit: int | None = 25) DatabaseList
-
- Parameters
limit (int | None) – Maximum number of databases to return. Defaults to 25. Set to -1, float(“inf”) or None to return all items.
- Returns
List of requested databases.
- Return type
Examples
List the first 5 databases:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> db_list = c.raw.databases.list(limit=5)
Iterate over databases:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> for db in c.raw.databases: ... db # do something with the db
Iterate over chunks of databases to reduce memory load:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> for db_list in c.raw.databases(chunk_size=2500): ... db_list # do something with the dbs
Create new databases
- RawDatabasesAPI.create(name: str) Database
- RawDatabasesAPI.create(name: list[str]) DatabaseList
-
- Parameters
name (str | list[str]) – A db name or list of db names to create.
- Returns
Database or list of databases that has been created.
- Return type
Examples
Create a new database:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> res = c.raw.databases.create("db1")
Delete databases
- RawDatabasesAPI.delete(name: str | Sequence[str], recursive: bool = False) None
-
- Parameters
name (str | Sequence[str]) – A db name or list of db names to delete.
recursive (bool) – Recursively delete all tables in the database(s).
Examples
Delete a list of databases:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> c.raw.databases.delete(["db1", "db2"])
Tables
List tables in a database
- RawTablesAPI.list(db_name: str, limit: int | None = 25) TableList
-
- Parameters
db_name (str) – The database to list tables from.
limit (int | None) – Maximum number of tables to return. Defaults to 25. Set to -1, float(“inf”) or None to return all items.
- Returns
List of requested tables.
- Return type
Examples
List the first 5 tables:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> table_list = c.raw.tables.list("db1", limit=5)
Iterate over tables:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> for table in c.raw.tables(db_name="db1"): ... table # do something with the table
Iterate over chunks of tables to reduce memory load:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> for table_list in c.raw.tables(db_name="db1", chunk_size=2500): ... table_list # do something with the tables
Create new tables in a database
- RawTablesAPI.create(db_name: str, name: str) Table
- RawTablesAPI.create(db_name: str, name: list[str]) TableList
-
- Parameters
db_name (str) – Database to create the tables in.
name (str | list[str]) – A table name or list of table names to create.
- Returns
Table or list of tables that has been created.
- Return type
Examples
Create a new table in a database:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> res = c.raw.tables.create("db1", "table1")
Delete tables from a database
- RawTablesAPI.delete(db_name: str, name: str | Sequence[str]) None
-
- Parameters
db_name (str) – Database to delete tables from.
name (str | Sequence[str]) – A table name or list of table names to delete.
Examples
Delete a list of tables:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> res = c.raw.tables.delete("db1", ["table1", "table2"])
Rows
Get a row from a table
- RawRowsAPI.retrieve(db_name: str, table_name: str, key: str) Row | None
-
- Parameters
db_name (str) – Name of the database.
table_name (str) – Name of the table.
key (str) – The key of the row to retrieve.
- Returns
The requested row.
- Return type
Row | None
Examples
Retrieve a row with key ‘k1’ from tablew ‘t1’ in database ‘db1’:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> row = c.raw.rows.retrieve("db1", "t1", "k1")
List rows in a table
- RawRowsAPI.list(db_name: str, table_name: str, min_last_updated_time: int | None = None, max_last_updated_time: int | None = None, columns: list[str] | None = None, limit: int | None = 25) RowList
-
- Parameters
db_name (str) – Name of the database.
table_name (str) – Name of the table.
min_last_updated_time (int | None) – Rows must have been last updated after this time (exclusive). ms since epoch.
max_last_updated_time (int | None) – Rows must have been last updated before this time (inclusive). ms since epoch.
columns (list[str] | None) – List of column keys. Set to None for retrieving all, use [] to retrieve only row keys.
limit (int | None) – The number of rows to retrieve. Defaults to 25. Set to -1, float(“inf”) or None to return all items.
- Returns
The requested rows.
- Return type
Examples
List rows:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> row_list = c.raw.rows.list("db1", "t1", limit=5)
Iterate over rows:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> for row in c.raw.rows(db_name="db1", table_name="t1", columns=["col1","col2"]): ... row # do something with the row
Iterate over chunks of rows to reduce memory load:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> for row_list in c.raw.rows(db_name="db1", table_name="t1", chunk_size=2500): ... row_list # do something with the rows
Insert rows into a table
- RawRowsAPI.insert(db_name: str, table_name: str, row: Sequence[Row] | Row | dict, ensure_parent: bool = False) None
Insert one or more rows into a table.
- Parameters
Examples
Insert new rows into a table:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> rows = {"r1": {"col1": "val1", "col2": "val1"}, "r2": {"col1": "val2", "col2": "val2"}} >>> c.raw.rows.insert("db1", "table1", rows)
Delete rows from a table
- RawRowsAPI.delete(db_name: str, table_name: str, key: str | Sequence[str]) None
-
- Parameters
db_name (str) – Name of the database.
table_name (str) – Name of the table.
key (str | Sequence[str]) – The key(s) of the row(s) to delete.
Examples
Delete rows from table:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> keys_to_delete = ["k1", "k2", "k3"] >>> c.raw.rows.delete("db1", "table1", keys_to_delete)
Retrieve pandas dataframe
- RawRowsAPI.retrieve_dataframe(db_name: str, table_name: str, min_last_updated_time: int | None = None, max_last_updated_time: int | None = None, columns: list[str] | None = None, limit: int | None = 25) pandas.DataFrame
Retrieve rows in a table as a pandas dataframe.
Rowkeys are used as the index.
- Parameters
db_name (str) – Name of the database.
table_name (str) – Name of the table.
min_last_updated_time (int | None) – Rows must have been last updated after this time. ms since epoch.
max_last_updated_time (int | None) – Rows must have been last updated before this time. ms since epoch.
columns (list[str] | None) – List of column keys. Set to None for retrieving all, use [] to retrieve only row keys.
limit (int | None) – The number of rows to retrieve. Defaults to 25. Set to -1, float(“inf”) or None to return all items.
- Returns
The requested rows in a pandas dataframe.
- Return type
pandas.DataFrame
Examples
Get dataframe:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> df = c.raw.rows.retrieve_dataframe("db1", "t1", limit=5)
Insert pandas dataframe
- RawRowsAPI.insert_dataframe(db_name: str, table_name: str, dataframe: Any, ensure_parent: bool = False) None
Insert pandas dataframe into a table
Use index as rowkeys.
- Parameters
db_name (str) – Name of the database.
table_name (str) – Name of the table.
dataframe (Any) – The dataframe to insert. Index will be used as rowkeys.
ensure_parent (bool) – Create database/table if they don’t already exist.
Examples
Insert new rows into a table:
>>> import pandas as pd >>> from cognite.client import CogniteClient >>> >>> c = CogniteClient() >>> df = pd.DataFrame(data={"a": 1, "b": 2}, index=["r1", "r2", "r3"]) >>> res = c.raw.rows.insert_dataframe("db1", "table1", df)
RAW Data classes
- class cognite.client.data_classes.raw.Database(name: str | None = None, created_time: int | None = None, cognite_client: CogniteClient | None = None)
Bases:
CogniteResource
A NoSQL database to store customer data.
- Parameters
name (str | None) – Unique name of a database.
created_time (int | None) – Time the database was created.
cognite_client (CogniteClient | None) – The client to associate with this object.
- class cognite.client.data_classes.raw.DatabaseList(resources: Collection[Any], cognite_client: CogniteClient | None = None)
Bases:
CogniteResourceList
[Database
]
- class cognite.client.data_classes.raw.Row(key: str | None = None, columns: dict[str, Any] | None = None, last_updated_time: int | None = None, cognite_client: CogniteClient | None = None)
Bases:
CogniteResource
No description.
- Parameters
key (str | None) – Unique row key
columns (dict[str, Any] | None) – Row data stored as a JSON object.
last_updated_time (int | None) – The number of milliseconds since 00:00:00 Thursday, 1 January 1970, Coordinated Universal Time (UTC), minus leap seconds.
cognite_client (CogniteClient | None) – The client to associate with this object.
- to_pandas() pandas.DataFrame
Convert the instance into a pandas DataFrame.
- Returns
The pandas DataFrame representing this instance.
- Return type
pandas.DataFrame
- class cognite.client.data_classes.raw.RowList(resources: Collection[Any], cognite_client: CogniteClient | None = None)
Bases:
CogniteResourceList
[Row
]- to_pandas() pandas.DataFrame
Convert the instance into a pandas DataFrame.
- Returns
The pandas DataFrame representing this instance.
- Return type
pandas.DataFrame
- class cognite.client.data_classes.raw.Table(name: str | None = None, created_time: int | None = None, cognite_client: CogniteClient | None = None)
Bases:
CogniteResource
A NoSQL database table to store customer data
- Parameters
name (str | None) – Unique name of the table
created_time (int | None) – Time the table was created.
cognite_client (CogniteClient | None) – The client to associate with this object.
- class cognite.client.data_classes.raw.TableList(resources: Collection[Any], cognite_client: CogniteClient | None = None)
Bases:
CogniteResourceList
[Table
]
Extraction pipelines
List extraction pipelines
- ExtractionPipelinesAPI.list(limit: int | None = 25) ExtractionPipelineList
-
- Parameters
limit (int | None) – Maximum number of ExtractionPipelines to return. Defaults to 25. Set to -1, float(“inf”) or None to return all items.
- Returns
List of requested ExtractionPipelines
- Return type
Examples
List ExtractionPipelines:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> ep_list = c.extraction_pipelines.list(limit=5)
Create extraction pipeline
- ExtractionPipelinesAPI.create(extraction_pipeline: ExtractionPipeline) ExtractionPipeline
- ExtractionPipelinesAPI.create(extraction_pipeline: Sequence[ExtractionPipeline]) ExtractionPipelineList
Create one or more extraction pipelines.
You can create an arbitrary number of extraction pipelines, and the SDK will split the request into multiple requests if necessary.
- Parameters
extraction_pipeline (ExtractionPipeline | Sequence[ExtractionPipeline]) – Extraction pipeline or list of extraction pipelines to create.
- Returns
Created extraction pipeline(s)
- Return type
Examples
Create new extraction pipeline:
>>> from cognite.client import CogniteClient >>> from cognite.client.data_classes import ExtractionPipeline >>> c = CogniteClient() >>> extpipes = [ExtractionPipeline(name="extPipe1",...), ExtractionPipeline(name="extPipe2",...)] >>> res = c.extraction_pipelines.create(extpipes)
Retrieve an extraction pipeline by ID
- ExtractionPipelinesAPI.retrieve(id: int | None = None, external_id: str | None = None) ExtractionPipeline | None
Retrieve a single extraction pipeline by id.
- Parameters
id (int | None) – ID
external_id (str | None) – External ID
- Returns
Requested extraction pipeline or None if it does not exist.
- Return type
ExtractionPipeline | None
Examples
Get extraction pipeline by id:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> res = c.extraction_pipelines.retrieve(id=1)
Get extraction pipeline by external id:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> res = c.extraction_pipelines.retrieve(external_id="1")
Retrieve multiple extraction pipelines by ID
- ExtractionPipelinesAPI.retrieve_multiple(ids: Sequence[int] | None = None, external_ids: Sequence[str] | None = None, ignore_unknown_ids: bool = False) ExtractionPipelineList
Retrieve multiple extraction pipelines by ids and external ids.
- Parameters
ids (Sequence[int] | None) – IDs
external_ids (Sequence[str] | None) – External IDs
ignore_unknown_ids (bool) – Ignore IDs and external IDs that are not found rather than throw an exception.
- Returns
The requested ExtractionPipelines.
- Return type
Examples
Get ExtractionPipelines by id:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> res = c.extraction_pipelines.retrieve_multiple(ids=[1, 2, 3])
Get assets by external id:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> res = c.extraction_pipelines.retrieve_multiple(external_ids=["abc", "def"], ignore_unknown_ids=True)
Update extraction pipelines
- ExtractionPipelinesAPI.update(item: ExtractionPipeline | ExtractionPipelineUpdate) ExtractionPipeline
- ExtractionPipelinesAPI.update(item: Sequence[ExtractionPipeline | ExtractionPipelineUpdate]) ExtractionPipelineList
Update one or more extraction pipelines
- Parameters
item (ExtractionPipeline | ExtractionPipelineUpdate | Sequence[ExtractionPipeline | ExtractionPipelineUpdate]) – Extraction pipeline(s) to update
- Returns
Updated extraction pipeline(s)
- Return type
Examples
Update an extraction pipeline that you have fetched. This will perform a full update of the extraction pipeline:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> update = ExtractionPipelineUpdate(id=1) >>> update.description.set("Another new extpipe") >>> res = c.extraction_pipelines.update(update)
Delete extraction pipelines
- ExtractionPipelinesAPI.delete(id: int | Sequence[int] | None = None, external_id: str | Sequence[str] | None = None) None
Delete one or more extraction pipelines
- Parameters
id (int | Sequence[int] | None) – Id or list of ids
external_id (str | Sequence[str] | None) – External ID or list of external ids
Examples
Delete extraction pipelines by id or external id:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> c.extraction_pipelines.delete(id=[1,2,3], external_id="3")
Extraction pipeline runs
List runs for an extraction pipeline
- ExtractionPipelineRunsAPI.list(external_id: str, statuses: Sequence[str] | None = None, message_substring: str | None = None, created_time: dict[str, Any] | TimestampRange | None = None, limit: int | None = 25) ExtractionPipelineRunList
List runs for an extraction pipeline with given external_id
- Parameters
external_id (str) – Extraction pipeline external Id.
statuses (Sequence[str] | None) – One or more among “success” / “failure” / “seen”.
message_substring (str | None) – Failure message part.
created_time (dict[str, Any] | TimestampRange | None) – The number of milliseconds since 00:00:00 Thursday, 1 January 1970, Coordinated Universal Time (UTC), minus leap seconds.
limit (int | None) – Maximum number of ExtractionPipelines to return. Defaults to 25. Set to -1, float(“inf”) or None to return all items.
- Returns
List of requested extraction pipeline runs
- Return type
Examples
List extraction pipeline runs:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> runsList = c.extraction_pipelines.runs.list(external_id="test ext id", limit=5)
Filter extraction pipeline runs on a given status:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> runsList = c.extraction_pipelines.runs.list(external_id="test ext id", statuses=["seen"], statuslimit=5)
Report new runs
- ExtractionPipelineRunsAPI.create(run: ExtractionPipelineRun) ExtractionPipelineRun
- ExtractionPipelineRunsAPI.create(run: Sequence[ExtractionPipelineRun]) ExtractionPipelineRunList
Create one or more extraction pipeline runs.
You can create an arbitrary number of extraction pipeline runs, and the SDK will split the request into multiple requests.
- Parameters
run (ExtractionPipelineRun | Sequence[ExtractionPipelineRun]) – Extraction pipeline or list of extraction pipeline runs to create.
- Returns
Created extraction pipeline run(s)
- Return type
Examples
Report a new extraction pipeline run:
>>> from cognite.client import CogniteClient >>> from cognite.client.data_classes import ExtractionPipelineRun >>> c = CogniteClient() >>> res = c.extraction_pipelines.runs.create( ... ExtractionPipelineRun(status="success", extpipe_external_id="extId"))
Extraction pipeline configs
Get the latest or a specific config revision
- ExtractionPipelineConfigsAPI.retrieve(external_id: str, revision: int | None = None, active_at_time: int | None = None) ExtractionPipelineConfig
Retrieve a specific configuration revision, or the latest by default <https://developer.cognite.com/api#tag/Extraction-Pipelines-Config/operation/getExtPipeConfigRevision>
By default the latest configuration revision is retrieved, or you can specify a timestamp or a revision number.
- Parameters
external_id (str) – External id of the extraction pipeline to retrieve config from.
revision (int | None) – Optionally specify a revision number to retrieve.
active_at_time (int | None) – Optionally specify a timestamp the configuration revision should be active.
- Returns
Retrieved extraction pipeline configuration revision
- Return type
Examples
Retrieve latest config revision:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> res = c.extraction_pipelines.config.retrieve("extId")
List configuration revisions
- ExtractionPipelineConfigsAPI.list(external_id: str) ExtractionPipelineConfigRevisionList
Retrieve all configuration revisions from an extraction pipeline <https://developer.cognite.com/api#tag/Extraction-Pipelines-Config/operation/listExtPipeConfigRevisions>
- Parameters
external_id (str) – External id of the extraction pipeline to retrieve config from.
- Returns
Retrieved extraction pipeline configuration revisions
- Return type
Examples
Retrieve a list of config revisions:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> res = c.extraction_pipelines.config.list("extId")
Create a config revision
- ExtractionPipelineConfigsAPI.create(config: ExtractionPipelineConfig) ExtractionPipelineConfig
Create a new configuration revision <https://developer.cognite.com/api#tag/Extraction-Pipelines-Config/operation/createExtPipeConfig>
- Parameters
config (ExtractionPipelineConfig) – Configuration revision to create.
- Returns
Created extraction pipeline configuration revision
- Return type
Examples
Create a config revision:
>>> from cognite.client import CogniteClient >>> from cognite.client.data_classes import ExtractionPipelineConfig >>> c = CogniteClient() >>> res = c.extraction_pipelines.config.create(ExtractionPipelineConfig(external_id="extId", config="my config contents"))
Revert to an earlier config revision
- ExtractionPipelineConfigsAPI.revert(external_id: str, revision: int) ExtractionPipelineConfig
Revert to a previous configuration revision <https://developer.cognite.com/api#tag/Extraction-Pipelines-Config/operation/revertExtPipeConfigRevision>
- Parameters
external_id (str) – External id of the extraction pipeline to revert revision for.
revision (int) – Revision to revert to.
- Returns
New latest extraction pipeline configuration revision.
- Return type
Examples
Revert a config revision:
>>> from cognite.client import CogniteClient >>> c = CogniteClient() >>> res = c.extraction_pipelines.config.revert("extId", 5)
Extractor Config Data classes
- class cognite.client.data_classes.extractionpipelines.ExtractionPipeline(id: int | None = None, external_id: str | None = None, name: str | None = None, description: str | None = None, data_set_id: int | None = None, raw_tables: list[dict[str, str]] | None = None, last_success: int | None = None, last_failure: int | None = None, last_message: str | None = None, last_seen: int | None = None, schedule: str | None = None, contacts: list[ExtractionPipelineContact] | None = None, metadata: dict[str, str] | None = None, source: str | None = None, documentation: str | None = None, created_time: int | None = None, last_updated_time: int | None = None, created_by: str | None = None, cognite_client: CogniteClient | None = None)
Bases:
CogniteResource
An extraction pipeline is a representation of a process writing data to CDF, such as an extractor or an ETL tool.
- Parameters
id (int | None) – A server-generated ID for the object.
external_id (str | None) – The external ID provided by the client. Must be unique for the resource type.
name (str | None) – The name of the extraction pipeline.
description (str | None) – The description of the extraction pipeline.
data_set_id (int | None) – The id of the dataset this extraction pipeline related with.
raw_tables (list[dict[str, str]] | None) – list of raw tables in list format: [{“dbName”: “value”, “tableName” : “value”}].
last_success (int | None) – Milliseconds value of last success status.
last_failure (int | None) – Milliseconds value of last failure status.
last_message (str | None) – Message of last failure.
last_seen (int | None) – Milliseconds value of last seen status.
schedule (str | None) – None/On trigger/Continuous/cron regex.
contacts (list[ExtractionPipelineContact] | None) – list of contacts
metadata (dict[str, str] | None) – Custom, application specific metadata. String key -> String value. Limits: Maximum length of key is 128 bytes, value 10240 bytes, up to 256 key-value pairs, of total size at most 10240.
source (str | None) – Source text value for extraction pipeline.
documentation (str | None) – Documentation text value for extraction pipeline.
created_time (int | None) – The number of milliseconds since 00:00:00 Thursday, 1 January 1970, Coordinated Universal Time (UTC), minus leap seconds.
last_updated_time (int | None) – The number of milliseconds since 00:00:00 Thursday, 1 January 1970, Coordinated Universal Time (UTC), minus leap seconds.
created_by (str | None) – Extraction pipeline creator, usually an email.
cognite_client (CogniteClient | None) – The client to associate with this object.
- class cognite.client.data_classes.extractionpipelines.ExtractionPipelineConfig(external_id: str | None = None, config: str | None = None, revision: int | None = None, description: str | None = None, created_time: int | None = None, cognite_client: CogniteClient | None = None)
Bases:
ExtractionPipelineConfigRevision
An extraction pipeline config
- Parameters
external_id (str | None) – The external ID of the associated extraction pipeline.
config (str | None) – Contents of this configuration revision.
revision (int | None) – The revision number of this config as a positive integer.
description (str | None) – Short description of this configuration revision.
created_time (int | None) – The number of milliseconds since 00:00:00 Thursday, 1 January 1970, Coordinated Universal Time (UTC), minus leap seconds.
cognite_client (CogniteClient | None) – The client to associate with this object.
- class cognite.client.data_classes.extractionpipelines.ExtractionPipelineConfigRevision(external_id: str | None = None, revision: int | None = None, description: str | None = None, created_time: int | None = None, cognite_client: CogniteClient | None = None)
Bases:
CogniteResource
An extraction pipeline config revision
- Parameters
external_id (str | None) – The external ID of the associated extraction pipeline.
revision (int | None) – The revision number of this config as a positive integer.
description (str | None) – Short description of this configuration revision.
created_time (int | None) – The number of milliseconds since 00:00:00 Thursday, 1 January 1970, Coordinated Universal Time (UTC), minus leap seconds.
cognite_client (CogniteClient | None) – The client to associate with this object.
- class cognite.client.data_classes.extractionpipelines.ExtractionPipelineConfigRevisionList(resources: Collection[Any], cognite_client: CogniteClient | None = None)
Bases:
CogniteResourceList
[ExtractionPipelineConfigRevision
]
- class cognite.client.data_classes.extractionpipelines.ExtractionPipelineContact(name: str, email: str, role: str, send_notification: bool)
Bases:
dict
A contact for an extraction pipeline
- Parameters
name (str) – Name of contact
email (str) – Email address of contact
role (str) – Role of contact, such as Owner, Maintainer, etc.
send_notification (bool) – Whether to send notifications to this contact or not
- class cognite.client.data_classes.extractionpipelines.ExtractionPipelineList(resources: Collection[Any], cognite_client: CogniteClient | None = None)
Bases:
CogniteResourceList
[ExtractionPipeline
],IdTransformerMixin
- class cognite.client.data_classes.extractionpipelines.ExtractionPipelineRun(extpipe_external_id: str | None = None, status: str | None = None, message: str | None = None, created_time: int | None = None, cognite_client: CogniteClient | None = None, id: int | None = None)
Bases:
CogniteResource
A representation of an extraction pipeline run.
- Parameters
extpipe_external_id (str | None) – The external ID of the extraction pipeline.
status (str | None) – success/failure/seen.
message (str | None) – Optional status message.
created_time (int | None) – The number of milliseconds since 00:00:00 Thursday, 1 January 1970, Coordinated Universal Time (UTC), minus leap seconds.
cognite_client (CogniteClient | None) – The client to associate with this object.
id (int | None) – A server-generated ID for the object.
- dump(camel_case: bool = False) dict[str, Any]
Dump the instance into a json serializable Python data type.
- Parameters
camel_case (bool) – Use camelCase for attribute names. Defaults to False.
- Returns
A dictionary representation of the instance.
- Return type
dict[str, Any]
- class cognite.client.data_classes.extractionpipelines.ExtractionPipelineRunFilter(external_id: str | None = None, statuses: Sequence[str] | None = None, message: StringFilter | None = None, created_time: dict[str, Any] | TimestampRange | None = None)
Bases:
CogniteFilter
Filter runs with exact matching
- Parameters
external_id (str | None) – The external ID of related ExtractionPipeline provided by the client. Must be unique for the resource type.
statuses (Sequence[str] | None) – success/failure/seen.
message (StringFilter | None) – message filter.
created_time (dict[str, Any] | TimestampRange | None) – Range between two timestamps.
- class cognite.client.data_classes.extractionpipelines.ExtractionPipelineRunList(resources: Collection[Any], cognite_client: CogniteClient | None = None)
- class cognite.client.data_classes.extractionpipelines.ExtractionPipelineUpdate(id: int | None = None, external_id: str | None = None)
Bases:
CogniteUpdate
Changes applied to an extraction pipeline
- Parameters
id (int) – A server-generated ID for the object.
external_id (str) – The external ID provided by the client. Must be unique for the resource type.
- class cognite.client.data_classes.extractionpipelines.StringFilter(substring: str | None = None)
Bases:
CogniteFilter
Filter runs on substrings of the message
- Parameters
substring (str | None) – Part of message