It is easily used with spark code, easy logging with cloudwatch and easy to debug.Run time is also very less compared to other etl tools
AWS Glue is not user friendly,the transformation components that we have are not useful in different scenarios and we need to use custom transformation for everything,including even very basic operations.
The thing I like the most about logstash is the ability to adjust it to whatever you are doing. If it is your own custom project, or a standard input source it will bend to your needs.
It is easily used with spark code, easy logging with cloudwatch and easy to debug.Run time is also very less compared to other etl tools
The thing I like the most about logstash is the ability to adjust it to whatever you are doing. If it is your own custom project, or a standard input source it will bend to your needs.
AWS Glue is not user friendly,the transformation components that we have are not useful in different scenarios and we need to use custom transformation for everything,including even very basic operations.