About Integrator

Automated ETL task management for file-based data integrations.

What is Integrator?

Integrator is a scheduled ETL (Extract, Transform, Load) platform that automates the movement and transformation of data files between disparate systems. Define a task once — specify where to read from, how to transform the data, and where to write it — then let the scheduler handle the rest. Each run is logged with record counts, duration, and status so you always know what happened and when.

Connectors

Sources & Destinations

  • FTP / SFTP — read from or write to remote file servers, with optional file mask, archiving, and move-after-read.
  • Local Folder — watch a directory for incoming files; write output to any accessible path.
  • REST API — HTTP GET source with configurable endpoint, headers, and API key.
  • Web Service (SOAP) — call a SOAP endpoint and use the response body as source data.
  • Email (IMAP) — fetch attachments from an email inbox as the source file. Email is also supported as a destination — deliver the output as an email attachment.
  • SQL Server Database — read from a view or table via SELECT * (source), or bulk-insert into a target table with Insert or Truncate + Insert write modes (destination).

File Formats

Read & Write

  • CSV — delimited text with configurable delimiter and optional header row.
  • JSON — arrays of objects; nested structures are flattened on read.
  • XML — element-based records; configurable record element name.
  • XLSX — Excel workbooks; reads the first sheet, writes with auto-sized columns.

Format Conversion

Any supported source format can be converted to any supported destination format in a single task — no intermediate steps required.

Transform Operations

Apply an ordered pipeline of transformations to each row before writing. Rules are configured per task and stored with the task — no code required.

  • Select Columns — keep only the columns you need, in any order.
  • Remove Column — drop a column by name.
  • Rename Column — change a column header.
  • Reformat Date — parse a date column in one format and emit it in another.
  • Trim — strip leading and trailing whitespace from a column's values.
  • To Upper / To Lower — change case of a column's values.
  • Add Constant — add a new column with a static or token-resolved value ({today}, {now}, {guid}, etc.), optionally positioned after an existing column.
  • Filter Rows — keep or discard rows based on column value conditions (equals, contains, starts with, is empty, and more).
  • Find & Replace — substitute text within a column's values.
  • Split Column — split a column's value on a delimiter into one or more new columns, inserted in its place.

Use the Transform Preview panel on any task to upload a sample file and see exactly what the pipeline produces before going live.

Scheduling & Monitoring

  • Cron scheduling — every task runs on a standard cron schedule (e.g. 0 6 * * * for daily at 06:00). Powered by Hangfire.
  • Run history — every execution is logged with date, status, records read/written/failed, and duration. Filter by status or date range.
  • Failure alerts — send an email notification the first time a task fails; suppressed on repeated failures until it recovers.
  • Zero-records alerts — optionally alert when a source returns no records, with the same once-per-incident suppression.
  • Success notifications — optional per-task success email with record counts.
  • ZIP compression — optionally compress output files as ZIP archives, with optional AES-256 password encryption, before delivery to any file or email destination.
  • Hangfire dashboard — Admin users can view queued, processing, succeeded, and failed background jobs at /hangfire.

Security & Users

  • Role-based access: Admin, Manager, User.
  • Two-factor authentication (TOTP authenticator app).
  • Optional public registration or invite-only mode.
  • Admin user management — lock, unlock, delete, assign roles.
  • Connection credentials encrypted at rest.

Admin Tools

  • Test Receiver — an HTTP endpoint that accepts POST requests and displays the received payload, useful for testing API destination tasks.
  • Test Connection — validate FTP/SFTP/IMAP credentials before saving.
  • Backup & Restore — export all task configurations to JSON; re-import on another instance.
  • App Settings — runtime key/value configuration editable without redeploying.

Platform

  • Built on ASP.NET Core 10, runs on Windows, Linux, or Docker.
  • SQL Server 2022 via Entity Framework Core 10.
  • Light and dark mode — preference saved per browser.
  • Installable as a Progressive Web App (PWA) on desktop and mobile.
  • Structured logging via Serilog with optional Seq integration.

Ready to get started? Sign in to manage your ETL tasks.

Sign in