Skip to main content

9/12 - Apply Default Transformers

· One min read
Evis Drenova
Co-Founder/CEO, Neosync
  1. Add support for duplicating NoSQL Mappings inline
  2. Optimized Subset Query builder to be much faster and more efficient
  3. Updated NoSQL Mapping table to catch duplicate mappings
  4. Add support for skipping foreign key errors
  5. Add support for Postgres generated always column types to passthrough
  6. Support special characters in schema/table names
  7. Expose SQL statements in Runs page
  8. Extend the Job/Transformer/Connection/API key name limit from 30 to 100 characters
  9. Add support for applying default transformers to the Mapping table with one click
  10. Surface Generated column badges in the Job Mapping table
  11. Support SQL Server Truncate options
  12. Add support for Team accounts in OSS Neosync
  13. Add real time validation for connections in the Connect page
  14. Add a Country Code Transformer

8/29 - SQL Server support

· One min read
Evis Drenova
Co-Founder/CEO, Neosync
  1. Add support updating Mongo DB mappings in line
  2. Add support for Microsoft SQL Server
  3. Add support for MSSQL tunneling
  4. Add support for special characters in mysql connection
  5. Add new documentation for how to set up logging
  6. Add new documentation for MongoDB

8/15 - DynamoDB Upgrades

· One min read
Evis Drenova
Co-Founder/CEO, Neosync
  1. Update default GPT models in Neosync
  2. Added initial support for SQL Server
  3. Added support for ConsistentReads in DynamoDB
  4. Support seeds for all transformers for deterministic outputs
  5. Add support for DynamoDB key deep linking
  6. Add support for configuring app resources in helm chart
  7. Fix benthos issue from main lib that was causing type loss in DynamoDB
  8. Add subsetting to DynamoDB
  9. Add support to DynamoDB for default transformations of unmapped types
  10. Fix a bug in Mysql that occurred when a column was named with a reserved keyword

8/01 - DynamoDB

· One min read
Evis Drenova
Co-Founder/CEO, Neosync
  1. First class support for integrating with DynamoDB
  2. Fixed a bug that was causing some Redis values to not get cleaned up
  3. Update generate_state transformer to return full state names as an option
  4. Add role permissions to MYSQL connection
  5. Improve mysql init schema options to resolve circular dependencies
  6. Add auto-complete to custom javascript transformers
  7. Update Connect page to ensure that users only select valid destinations based on the source connection
  8. Support subsetting within DynamoDB
  9. Update integration tests to parallelize
  10. Fix a rare data race issue that occurs in Benthos

7/18 - Base Transformers in Custom Transformers

· One min read
Evis Drenova
Co-Founder/CEO, Neosync
  1. Support for accessing transformers within custom javascript transformers
  2. Fixed a bug within the init schema option that occurred when a sequence already existed
  3. Updated Mysql connection to be more flexible and handle URL parsing
  4. Updated docs to include auto-generated docs for transformers in custom transformers

7/04 - Job Cloning

· One min read
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support for MongoDb TLS certificates for TLS
  2. Added support for MongoDb connection pooling
  3. Added support for the ability to clone a job
  4. Added support for Google Cloud Storage as a destination connection
  5. Added support for publishing to Artifact hub
  6. Added a batch size config option to the OpenAI generator
  7. Added support for being able to use generators and transformers inside of the javascript transformers
  8. Better handling of OpenAI generator token limits
  9. Added support for configuring sidecars in helm charts

6/20 - MongoDb

· One min read
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support for MongoDb as a connection
  2. Updated Linux support so that you can run the gen.sh script to stand up environment locally
  3. Updated Supabase connection to pull in the schema role permission correctly
  4. Updated worker to handle newer SQL compliant syntax for defining auto-incrementing columns
  5. Added support for identity columns in Postgres
  6. Updated circular dependencies to handle complex dependencies with subsets

6/06 - Real time schema validation

· One min read
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support for Postgres Client Certificates
  2. Added support for creating table indices on init
  3. Added support for real time constraint validation
  4. Added an option to the email transformer to handle invalid email addresses
  5. Added root label to the subset page to denote root tables for subsetting
  6. Added button to get the row count of a subsetted table
  7. Added support for Postgres custom datatypes/functions/sequences etc
  8. Added support for column auto-complete within subsetted
  9. Fixed a bug that was causing mysql system queries to use int32 instead of int64
  10. Various UI/UX refinements

5/23 - Flexible Schema References

· One min read
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support for JSONB columns in subsetting section
  2. Updated error handling to be more responsive in worker
  3. Fixed a bug that was causing the init schema to skip on generate jobs
  4. Update Terraform provider to retrieve system transformer by source
  5. Exposed a logout Url override in the helm chart
  6. Added support for Float transformer precision
  7. Added support for unique email addresses in email transformer
  8. Fixed a bug that was causing truncate to fail before an insert when there was only a single table
  9. Added support for selecting a different connection that we pull the schema from which doesn't have to be the destination
  10. Various UI/UX refinements

5/7 - AI Generated Synthetic Data

· One min read
Evis Drenova
Co-Founder/CEO, Neosync
  1. Added support for AI generated synthetic data
  2. Support popping a missing column from the jobs mapping table to update mappings
  3. Support searching in the subset table
  4. Support the Transform Javascript transformer on foreign keys
  5. Support for generated columns
  6. New connection page now filters to correct database type based on source connection
  7. Transformer column in the job mapping page is now searchable
  8. Support for setting the precision in the Float64 transformers
  9. Job Mapping page list boxes now take the account into consideration when filtering
  10. Added support for unique email addresses in the Email Transformers
  11. Various UI/UX refinements