About Integrator
Automated ETL task management for file-based data integrations.
What is Integrator?
Integrator is a scheduled ETL (Extract, Transform, Load) platform that automates the movement and transformation of data files between disparate systems. Define a task once — specify where to read from, how to transform the data, and where to write it — then let the scheduler handle the rest. Each run is logged with record counts, duration, and status so you always know what happened and when.
Connectors
Sources & Destinations
- • FTP / SFTP — read from or write to remote file servers, with optional file mask, archiving, and move-after-read.
- • Local Folder — watch a directory for incoming files; write output to any accessible path.
- • REST API — HTTP GET source with configurable endpoint, headers, and API key.
- • Web Service (SOAP) — call a SOAP endpoint and use the response body as source data.
- • Email (IMAP) — fetch attachments from an email inbox as the source file. Email is also supported as a destination — deliver the output as an email attachment.
-
•
SQL Server Database — read from a view or table via
SELECT *(source), or bulk-insert into a target table with Insert or Truncate + Insert write modes (destination).
File Formats
Read & Write
- • CSV — delimited text with configurable delimiter and optional header row.
- • JSON — arrays of objects; nested structures are flattened on read.
- • XML — element-based records; configurable record element name.
- • XLSX — Excel workbooks; reads the first sheet, writes with auto-sized columns.
Format Conversion
Any supported source format can be converted to any supported destination format in a single task — no intermediate steps required.
Transform Operations
Apply an ordered pipeline of transformations to each row before writing. Rules are configured per task and stored with the task — no code required.
- ✓Select Columns — keep only the columns you need, in any order.
- ✓Remove Column — drop a column by name.
- ✓Rename Column — change a column header.
- ✓Reformat Date — parse a date column in one format and emit it in another.
- ✓Trim — strip leading and trailing whitespace from a column's values.
- ✓To Upper / To Lower — change case of a column's values.
- ✓Add Constant — add a new column with a static or token-resolved value (
{today},{now},{guid}, etc.), optionally positioned after an existing column. - ✓Filter Rows — keep or discard rows based on column value conditions (equals, contains, starts with, is empty, and more).
- ✓Find & Replace — substitute text within a column's values.
- ✓Split Column — split a column's value on a delimiter into one or more new columns, inserted in its place.
Use the Transform Preview panel on any task to upload a sample file and see exactly what the pipeline produces before going live.
Scheduling & Monitoring
-
•
Cron scheduling — every task runs on a standard cron schedule (e.g.
0 6 * * *for daily at 06:00). Powered by Hangfire. - • Run history — every execution is logged with date, status, records read/written/failed, and duration. Filter by status or date range.
- • Failure alerts — send an email notification the first time a task fails; suppressed on repeated failures until it recovers.
- • Zero-records alerts — optionally alert when a source returns no records, with the same once-per-incident suppression.
- • Success notifications — optional per-task success email with record counts.
- • ZIP compression — optionally compress output files as ZIP archives, with optional AES-256 password encryption, before delivery to any file or email destination.
-
•
Hangfire dashboard — Admin users can view queued, processing, succeeded, and failed background jobs at
/hangfire.
Security & Users
- •Role-based access: Admin, Manager, User.
- •Two-factor authentication (TOTP authenticator app).
- •Optional public registration or invite-only mode.
- •Admin user management — lock, unlock, delete, assign roles.
- •Connection credentials encrypted at rest.
Admin Tools
- •Test Receiver — an HTTP endpoint that accepts POST requests and displays the received payload, useful for testing API destination tasks.
- •Test Connection — validate FTP/SFTP/IMAP credentials before saving.
- •Backup & Restore — export all task configurations to JSON; re-import on another instance.
- •App Settings — runtime key/value configuration editable without redeploying.
Platform
- •Built on ASP.NET Core 10, runs on Windows, Linux, or Docker.
- •SQL Server 2022 via Entity Framework Core 10.
- •Light and dark mode — preference saved per browser.
- •Installable as a Progressive Web App (PWA) on desktop and mobile.
- •Structured logging via Serilog with optional Seq integration.
Ready to get started? Sign in to manage your ETL tasks.
Sign in