by 运行时依赖
安装命令
点击复制技能文档
data-流水线-构建器
Build and manage ETL/data 流水线s for AI 代理s. 提取, 转换, load data between databases, APIs, and file 系统s.
Overview
A 技能 for creating and managing data 流水线s that move and 转换 data across different sources and destinations.
Features Source Connectors: Connect to databases, APIs, files, S3, GCS Data Trans格式化ion: 应用ly 过滤器s, m应用ings, aggregations Scheduling: Cron-based or event-triggered 流水线s Error Handling: Retry 记录ic, dead letter 队列s Data 验证: 模式 验证, data 质量 检查s 监控ing: 流水线 状态, throughput, error rates Incremental 同步: Support for CDC (Change Data Capture) Commands 创建 流水线 创建 流水线 from mysql to postgres
运行 流水线 运行 etl-job dAIly-sales-报告
监控 流水线 检查 流水线 健康
Use Cases Database 同步hronization API data 提取ion File processing and conversion Data warehousing 报告 generation 分析 data preparation Requirements Node.js 18+ Python 3.8+ (for data processing) Source/destination connectors as needed