# AWS resource enrichment Copy as Markdown[Open in ChatGPT](https://chatgpt.com/?q=Read%20https%3A%2F%2Fdocs-docusaurus.kinsta.page%2Fuser-guides%2Fenrichment_rules%2Faws_resource_enrichment.md%20and%20help%20me%20with%20my%20question%20about%20this%20Coralogix%20documentation%20page.)[Open in Claude](https://claude.ai/new?q=Read%20https%3A%2F%2Fdocs-docusaurus.kinsta.page%2Fuser-guides%2Fenrichment_rules%2Faws_resource_enrichment.md%20and%20help%20me%20with%20my%20question%20about%20this%20Coralogix%20documentation%20page.) Coralogix now offers **AWS Resource Enrichment**, allowing you to enrich your logs with tags from Amazon Web Services (AWS) EC2 instances. Use this feature to **connect your business and operation metadata** from AWS and gain greater insight into your data. ## Overview[​](#overview "Direct link to Overview") The feature enriches every log containing the following fields with metadata. | ec2\_instance\_id | OpenTelemetry | | ----------------- | ------------- | | instance\_id | Fluentd | | ec2\_instance\_id | Fluent Bit | **Sample Otel Log Before Enrichment** ``` { resource:{ attributes:{ cloud.availability_zone:us-east-1b cloud.platform:aws_ec2 cloud.provider:aws cloud.region:us-east-1 ec2_instance_id:i-0c352ce4c433c58a5 host.image.id:ami-051f7e7f6c2f40dc1 host.name:ip-172-31-37-204.ec2.internal host.type:t2.micro } } scope:{ attributes:{} } resourceSchemaUrl: logRecord:{ attributes:{ log.file.name:log2.log log.file.path:log2.log } body:{ account_id:035955823196 application_name:my application test ec2_instance_type:t2.micro ec2_region:us-east-1 hosename:ip-172-31-37-204.ec2.internal image_id:ami-051f7e7f6c2f40dc1 kubernetes:{ container_name:service-0 docker_id:12345186e060681175942786de75a102c679f13c3f0fb330231bdd94c5570e2 labels:{ app.kubernetes.io\\/managed-by:Helm statefulset.kubernetes.io\\/pod-name:service-0 } namespace_name:default pod_id:123456-aefb-456e-b315-77b014de9d5b pod_name:service-0 } log:[INFO] 2022-11-15T12:55:36,768 kafka.streams.processor.internals.StateDirectory service-0 stream-thread [categorization-0-CleanupThread] Deleting obsolete state directory 0_2 for task 0_2 as 32827574178ms has elapsed (cleanup delay is 600000ms). platform:aws_ec2 stream:stdout time:2022-11-15T12:55:36.768697532Z } observedTimeUnixNano:1694069570457198600 } } ``` **AWS Enrichment** [![](data:image/webp;base64,UklGRpoSAABXRUJQVlA4II4SAABwiQCdASoABMgAPm02mUkkIyKhIjIYwIANiWlu9kAYkV+uI4QFF/7oBqHmRZeVf692rf2j8jvP38T+V/rP5Uesp/X9KBqU/E/sl+P/uno/3z/iX69/svsQ+QL8X/kf90+4HhutB/z/oBer/z7/if4D95P7x5zf856NfTv/Ye4B/Lv5T/t/Vz+xeBF8v/1PsAfyn+2/87/TfmZ9JH8//4f9V+YHtf/Lf8x/6P818Av84/sv/dDAok/PbAQWFNu9cNDvoniiF7RFEe9gIIB07oAeAc+cnJeSpU0FvsQD/YyxQATaWzNWJngyyfOcUavmvE5mboHQOgdA6Bz9rwJJXMwZ+T8n5Pyfk/J+T8nvmEURM7egEZZ49pkNxn3wUQ9GQKc6hQjsEnx/iCevHBdHn5RkyRh7Z5LBuRBHQ+Avc+7JNJ0DoHQOgdA6B0DoHQOgdA6B0DoGT9JpTn3vTfsXCbltLePvMNty3R8sZxImzHt4wBGd7k9QYVcsvG4dnV0sMcJfRHH6qAVl7clxrBPFLmbbmX52DoM55aQTJYTq7JVrDto8YrWrNF0brPjoZP3On71R1uZDUAON2GAngydhe0G+DrXD7Cwk8JPCTwk8JPCTwk8JPCTwk5xH5O/SlQg6HBDc7f5SdSvfsg87SV9l11p7VSma1d7oSPSIlycN/58jdC//mBzqFbHskNLDt56SSNkZJqMz9ecMqSGkpEnmcroHES/9HB9JIoO1nAMBfB2JuJrJmAmS9giPoVeK/f1wH/24hzGzlSVlzwKk7qAy7WvSCBAfv379+/fv379+/fv379+/fv37uhOwHL+j981fMB7+TM5vKnmv6P379+/fv379+/fv379+86tXDr2Vc1BgcrRNfatyL4Rgc8q3jBStNuf03ATWt6ybk3JuTcm5Nybk3JuTcm5Nybk3JuTcmqrTEzUDiHVkIi3wYFbV/+2QS9BjS3SB7JkLEFFxPqakaUzYAi4Wajwk8JPCTwk8JPCTwbS0wWxl6yTSdA6B0DoHQOW5/pI+yAJXYxcQGytGkFQCRhPIBWD699KbZ5mMvy6WiVHhJ4SeEnhJ4Sdu6U5S20L1kmk6B0DoHQOgZLfek8Ptn/AF7KIzhGR89BX4VrAVDN6UUwJqcL3z2YYd+XeC+n2xBMu6PZZb3wx8MfDHwx8MfDHwx8MfDHwx8MfDHwx8MfDHwx8Me1S8lJRzFYlUjPeN8a+HUGQQsECIpKQ3x8MfDHwx8MfDHwx8MfDHwx8MfDHwx8MfDHwx8MfDHbQHj66fEvrK9sYHpFp1By58HE2fES3ApNz6ahj4Y+GPhj4Y+GPhj4Y+GPhj4Y+GPhj4Y+GPhj4Y+GO5LxcJSLUr5AQBK83tuOVIFkLB5LpMBYCwFgLAWAsBYCwFgLAWAsBYCwFgLAWAjT6b24QWlSfU5/KPhj4Y+GPhj4Y+GPhj4Y+GPhj4Y+GPhj4Y+GPhj4Y+BjLjNJIAAP72XMOv7e7fXrW1X99XXR6YUG3KAX+Cg9HSqzCj3JGX4Ji04Rbqi+jScuMAka5aPftQ7h3a7LqeaO7wo/uLQpz9a4kMl4RmsMM7C0JSp0ZnYVdFlRxOfznjl1gqqyp/JakjKSYIvkTdadcZAjI/kI93/5FO5v2F/Gi3uf7N9XZB3G21gX+lFDNH/Jr0xL8zKljpAvvc0LSj50hV0fJdLxW0D2PiqkN8fvbphyCN0Tdsbf16s7XmF+lAvK+85SKX+veHyJArsU2r9Z5GZX8TTIOBr3dacKldrAfF5ey4vzVK86JJPb8DqJm6/PA+Xd0DLVmrKIHpksy80lPs6Y6xlrZ5KRx4DE8dAzm5ebMF7hyVINCjCXmmZeyN4bi5zYGsmtIBHOS1nS6FphUt8pfxl/00ZcDvsIVDN5ep3ZEExJNXnsXPMWQkSlQPyNIDoDAfMJZ/x0xP3IpDVzYjJ5fcz/qdcaPCcuuafGt3XzQ7sn6j1fWFOjpWySFpUjzo2KXBmjoS9C/bjKQnS3RySFkHXhjRiODnRtnnnVc+Ex92LkXX93AMbZxTJsi9ZlMP7IiRfBXv8IsUKalO7lA3dRGfB63DCdMtT51Zniw3zjZPxOPu9VyLbfvCYvNlqFeflqN+P00qczxriW/zi4X1mb+/f2xM3zVSMwUZ8kK2GtYsj8ZAeU/pJHk3YyH89EbxmtMIMfPwOaGJc0zFtI9lqphv/EpNrBkmWMBaM3y7/eax98IzweiZLkLZjDaFlFRRO8Ez79+w6Gt0OcN/aaBU67R55FHcUCijzEsv7jXhlneNumW/ePNT4GsoDnie1n07sqw8X72k6gnbAWY+OB4RzmWI7yxAiFBeyrE7BVYftKBSI0HpZMUuhbh9UleMqHpYZKuqtE+lCfaHOyOvvfhJ1KtmbYu8XoYxJh1mJ5sgiZrrb0o3HHbO6APTopbWbIFrRocKrHDyQV0aISL4qQHTWTQ8iJ6bsqQ5YENaBwHkG5aXKtLAO/rl5Z8d7OGUwQaKqtz+SYYO+uXQQyVQ2RtkyFxUc2M2MAsb/UtnHXf71H6gFxt+RTHw6yZzdtHhIRfeDZ2bjLBY6yk1huSwzqe4T9Ap1JmRwSLRWWPhYqeRV+vHQcTUCq+pjxwuFoiSZEX0Mhc2RstsguQiHA6bBfcFeU3Ww+c2sDDdsZxVt7af19SFdHKYZiEwskVV2yOGvLhxqFOUGl/ejom+HXlspJ5ljVOTbP/Wk/emFTG9U+g9Er9hA8fM7gfm5mCvwRkuV0QiJ67/X4Af8gT0DOvK8p/drtLciEtPlrBYRx9uYp1GZNoxxC2TMP/zL8b2cdeqJEJ3SM0EgmwAAA8C6NizSWwYSMM7yEbmkveA5ZsVody8r/FEFQqkvhoopTTxEgdrLhttCsTX2N3HBPdMdyJnvNlcCn8nLhY2MYh6/Luk9nNSOAzfbOOW123h5CufWVKZh9r32E/IZh9a2qv307GR+/gNG46+ermzv6muh9Y9tFzgBkD+njRaSNXupogdvokw7nzp2YA1yKMIhtMfE7hrjbeBbET6R7mFetb8QhGN4KcTFbu2grW+axQ8Bocbz8sqcafurVv/rVkXd0g+O0b2rc1YPdqcJyYEnWvnnCE4zJlxGUM86279nH5f96WZubzQMxwljEY3weeHPmfacS2yRrsdO1HwUYOdZG7XXdrvpGr0dKe9BdL4pBhGLV7FtzaDaZJzRKtsjFWXyYbs3V09hoQ03wHT0WG7yqN3KzpLWro7A/588XEEnGArEavUdvJF5ca1uzEN3VoAKQxvaks7UgRYUkP92tuZbN8vi1OFtER8fYe+W/fiFbtrKsJlJ11aCeoLTTtftHW2z8dS1eCjU+vP9tof0/TrYrvYIpHEpZG1DRpju7OJSnipcI2lTw3VaO+QqbmAdSWA9HFDeY1RIpA4kVBpqAuCgUk3ZCT6fzA9FXD3fN4KX0nfWfvW0GxO2D0O/PpeP74JlLetzc+Jq9CRWy2wkhen1ah81MpZvU9eJT7/yUpR2xUvl/Lnf28u27XK9wozDYpflDYEZHyHJ/S8CDDfs2vTb/tTfI82mOYLLH82RWKdwFW/XK5xGslFdLXVeIp3bf8vUCWFTW29Ox/nLG7Xw3kX78vEyuos5AqTu4eVUCMkrPW8dVPfSAzYs7Xh2wo/0bQtFwuU330p/Bd/MTfrfM7XitT9jMZMdfeAUtnLV2a5rRtcNP/Izs6nPQ7/RXc6yJw0J5bcTIXBC6adpnO4hkwlgyQnNWJ9GswK89va++JzKUDd4PczWEeDPdUsEoxm03N/boHMG5TxC/DDfSRwaMZ8xj8zRtQO+v2IcuexrTZAdlJAR6Bjy4ustcOfOJzV1Lt7hqWmYQuYoO97BCpY55ZmFkMjVZjGO8PLdm7yDOOAa2/U+eOh6wPlDpMqAFhbOR2Q7GQb5e9BFo5EPDnjVDB8RTQUSoIgHPNLqhfgiMTVdKZY5yS60NiJxvEQVS5VFZu77j97cfyp3HL/EQgpB+FNVh/RWhq6dLmUaz2U5ytW8n+dwGhanFCsHRwKTXc8wsv0NTbVEZDe5f73w+aEntbI0aCZRUIxfokR9AMVX2h6gbkThqf70anFQOflNpc4P+MV9rZpj57DcbNDDq0dZ4PIDJotT8x9q64I1uoz0Wf7mqL2e24H9j9eCGvqrifS08UgOLyHAXJGNa645PHU7Hfl08px5W9YZWASC+7s3J5O1KkbJxLku8leF1rpxmVfSxoo/U1/I3rOrG1n1NxqXmV4aBXOKpl/xiwGihhzwVNhwfu9ymHcWY4i5qFFvFW1jkcwh2wDFrwLo1qUyg5gItcJZcysbP1NLc1NqnQFHmno7CFGHEwkaHnNQJtRa8VnaawJOCRva+FJ+REsH2anvIMlI6aRDrLojALG9XykZjPcyDn3Pvj5WnUyWKxST0wGlwuDuC5gao9DC4EHb3LqC04Uvek312i4i+RX2b6KWX0JKJQbJYT9rpC8Y8GxZmE+HxhAv4cccbgyRKX7vMoc2Wx8OQWbovxJ9C6Vd93whfWrojh3Wcq0X5roIj1D6QokyU2OmKk9gDI/s3MQDqj/Id3ZV8HFL6QgMzuJoAAAEr/1swZ9x6gjYADWpAPZdkGqYnhRf81aYeOPhW26MOA71ksN7qvdqsFQKOqs7SPodfD/QYynJje+ez0fWQAJY/4gMNzaU+GXCJLtWpKNq3AazGEL8CNHvNEwqrj7pmsejTpV/qGnX903/mZHw/1efuUf8OnMHzQy4/xhzV9bzPETb7GN5sleh9qcpDawWltvrWnq3mO0z+zX+/R3gWEPLXIw4eMN5zUAAAGzrCoSokZ/5k465+BIkoMGhzgH/kHt+n5Is5ER+P/783CySZ6olWFMXIFt2k/c9+fTczbwVV3be0hocNAXzKjVKA4Z4JWQTXyrVpcnJH/fEM4IB60VXILF9uFVos3SqZvae7TziN/77oRCQ+0cXN9Krap/S704XfSboxiNx+a/T6KF4v1GOdvF58ctV5cX2WCEHSyeX+YNdSYc+oPoZ3TKVg93RBqkWc2/y5ke/6CBFra14l3w3w3qVkyWco4rjW5AALzSsxO4o3Svjw5fF3lMunDpWce21gCAOsZLKhyVqnfhWw9yAOCLlYN/rWZRVrTk7g7wgncF7vdg7lmH1dA3A4Ks0YP/XbVqZR++vch4rQfR/nKAJa7qVBvK8T3biHYhUbAp0KKskF9wLA5lrFUMzeBaRoj0mCYEEnQvJ8PVaIAcqaKbPYMn7FrKdSpWapfS9rrVZb5anCqoROS7vyOl3aT7LBrEWh1kf+ikJcJa34B3Vy8/yoo09pW48pxlSC3j4xYMyAk94BrlcLXEiPBBpn4I9GIxQvf2n63crKbmPOQRj4FiMlqDPIj3omoA1YE7k5tTlfHUlwwTg22TmEcwjmEcwjmEcwjmEcotlgxOHqAC2R91c5dif0ixd14RTBVVIjk+Bae322YziPmTufL2nE8h0qcRwbHWGH9G4euqr0JISQSFkloE9mig3C11z3xkovZUEWfJgu/uvJ5btuXGwLIfd7NvhV6fT/MrAgIIvFX+asuq9xBRqI9Yo36gfGMnJeZCXJGPyXDeoJ9uG5EpqH07kT1+DFHtX/WPvCA27eyewLgXJSQpX1FeDBxGLrZC9yNCej85T9rIGxfgoQKWmrvdpyJ5+cUY48y1ZRl5K9bJvy67hc4y6Q1ccPfRKFIXVAtinL5bVWCn+jAgl4NTCRzq20SY+iBsKsc1PiwjP510817MXa1y+DMclxsJpbPlRn/4f9JarYAAB+cY2AYUKIgJMPr/4B6Pzdvps+nD8B9C20e+0vggKUb349ZhCqKXYzJsHIoHMFLg5/sFLsWisyOH3bUP2NKjR50bROKq76SEWEePYB9yXBzoAAA0UNlsmPfGehtKnyLxVv1skz5xOsMT93fIwN6DEEhSrg2okpHUpx5jDpVspOns95PKdoJOGdlWNNCRCH641i4Gr2B4FXBmrmQyQeIgyAD50yWclBFmsYiN4aLq5Ior9T06oJ17BMGNiYRHTqQc/n1zHL7sKOoBKlZ9OFZ0LbIA0DBm36cvgAAJp3rINvjrx5Ky57AhHNp8cUPIr6iIY1AA8b0jprmGK1PRQW0+WjFiV9zXTmw4MvjlNE7K4YU0GPTjH0Ka2OjxooJPSMxW5303WrYGvQkABUfM1CcxK9mE/0KBq/KQhJArdp1YtI2JWwjm3J/CYPvHE62MTEBCHruJ8JRA8s5fjbTtRfzvvvwQo3980pJatYAAAoIpdASL0mOR7QT29vb29vb29vb29vb29vb29vb29vb29vb29vdiZC8RAAAA)](data:image/webp;base64,UklGRpoSAABXRUJQVlA4II4SAABwiQCdASoABMgAPm02mUkkIyKhIjIYwIANiWlu9kAYkV+uI4QFF/7oBqHmRZeVf692rf2j8jvP38T+V/rP5Uesp/X9KBqU/E/sl+P/uno/3z/iX69/svsQ+QL8X/kf90+4HhutB/z/oBer/z7/if4D95P7x5zf856NfTv/Ye4B/Lv5T/t/Vz+xeBF8v/1PsAfyn+2/87/TfmZ9JH8//4f9V+YHtf/Lf8x/6P818Av84/sv/dDAok/PbAQWFNu9cNDvoniiF7RFEe9gIIB07oAeAc+cnJeSpU0FvsQD/YyxQATaWzNWJngyyfOcUavmvE5mboHQOgdA6Bz9rwJJXMwZ+T8n5Pyfk/J+T8nvmEURM7egEZZ49pkNxn3wUQ9GQKc6hQjsEnx/iCevHBdHn5RkyRh7Z5LBuRBHQ+Avc+7JNJ0DoHQOgdA6B0DoHQOgdA6B0DoGT9JpTn3vTfsXCbltLePvMNty3R8sZxImzHt4wBGd7k9QYVcsvG4dnV0sMcJfRHH6qAVl7clxrBPFLmbbmX52DoM55aQTJYTq7JVrDto8YrWrNF0brPjoZP3On71R1uZDUAON2GAngydhe0G+DrXD7Cwk8JPCTwk8JPCTwk8JPCTwk5xH5O/SlQg6HBDc7f5SdSvfsg87SV9l11p7VSma1d7oSPSIlycN/58jdC//mBzqFbHskNLDt56SSNkZJqMz9ecMqSGkpEnmcroHES/9HB9JIoO1nAMBfB2JuJrJmAmS9giPoVeK/f1wH/24hzGzlSVlzwKk7qAy7WvSCBAfv379+/fv379+/fv379+/fv37uhOwHL+j981fMB7+TM5vKnmv6P379+/fv379+/fv379+86tXDr2Vc1BgcrRNfatyL4Rgc8q3jBStNuf03ATWt6ybk3JuTcm5Nybk3JuTcm5Nybk3JuTcmqrTEzUDiHVkIi3wYFbV/+2QS9BjS3SB7JkLEFFxPqakaUzYAi4Wajwk8JPCTwk8JPCTwbS0wWxl6yTSdA6B0DoHQOW5/pI+yAJXYxcQGytGkFQCRhPIBWD699KbZ5mMvy6WiVHhJ4SeEnhJ4Sdu6U5S20L1kmk6B0DoHQOgZLfek8Ptn/AF7KIzhGR89BX4VrAVDN6UUwJqcL3z2YYd+XeC+n2xBMu6PZZb3wx8MfDHwx8MfDHwx8MfDHwx8MfDHwx8MfDHwx8Me1S8lJRzFYlUjPeN8a+HUGQQsECIpKQ3x8MfDHwx8MfDHwx8MfDHwx8MfDHwx8MfDHwx8MfDHbQHj66fEvrK9sYHpFp1By58HE2fES3ApNz6ahj4Y+GPhj4Y+GPhj4Y+GPhj4Y+GPhj4Y+GPhj4Y+GO5LxcJSLUr5AQBK83tuOVIFkLB5LpMBYCwFgLAWAsBYCwFgLAWAsBYCwFgLAWAjT6b24QWlSfU5/KPhj4Y+GPhj4Y+GPhj4Y+GPhj4Y+GPhj4Y+GPhj4Y+BjLjNJIAAP72XMOv7e7fXrW1X99XXR6YUG3KAX+Cg9HSqzCj3JGX4Ji04Rbqi+jScuMAka5aPftQ7h3a7LqeaO7wo/uLQpz9a4kMl4RmsMM7C0JSp0ZnYVdFlRxOfznjl1gqqyp/JakjKSYIvkTdadcZAjI/kI93/5FO5v2F/Gi3uf7N9XZB3G21gX+lFDNH/Jr0xL8zKljpAvvc0LSj50hV0fJdLxW0D2PiqkN8fvbphyCN0Tdsbf16s7XmF+lAvK+85SKX+veHyJArsU2r9Z5GZX8TTIOBr3dacKldrAfF5ey4vzVK86JJPb8DqJm6/PA+Xd0DLVmrKIHpksy80lPs6Y6xlrZ5KRx4DE8dAzm5ebMF7hyVINCjCXmmZeyN4bi5zYGsmtIBHOS1nS6FphUt8pfxl/00ZcDvsIVDN5ep3ZEExJNXnsXPMWQkSlQPyNIDoDAfMJZ/x0xP3IpDVzYjJ5fcz/qdcaPCcuuafGt3XzQ7sn6j1fWFOjpWySFpUjzo2KXBmjoS9C/bjKQnS3RySFkHXhjRiODnRtnnnVc+Ex92LkXX93AMbZxTJsi9ZlMP7IiRfBXv8IsUKalO7lA3dRGfB63DCdMtT51Zniw3zjZPxOPu9VyLbfvCYvNlqFeflqN+P00qczxriW/zi4X1mb+/f2xM3zVSMwUZ8kK2GtYsj8ZAeU/pJHk3YyH89EbxmtMIMfPwOaGJc0zFtI9lqphv/EpNrBkmWMBaM3y7/eax98IzweiZLkLZjDaFlFRRO8Ez79+w6Gt0OcN/aaBU67R55FHcUCijzEsv7jXhlneNumW/ePNT4GsoDnie1n07sqw8X72k6gnbAWY+OB4RzmWI7yxAiFBeyrE7BVYftKBSI0HpZMUuhbh9UleMqHpYZKuqtE+lCfaHOyOvvfhJ1KtmbYu8XoYxJh1mJ5sgiZrrb0o3HHbO6APTopbWbIFrRocKrHDyQV0aISL4qQHTWTQ8iJ6bsqQ5YENaBwHkG5aXKtLAO/rl5Z8d7OGUwQaKqtz+SYYO+uXQQyVQ2RtkyFxUc2M2MAsb/UtnHXf71H6gFxt+RTHw6yZzdtHhIRfeDZ2bjLBY6yk1huSwzqe4T9Ap1JmRwSLRWWPhYqeRV+vHQcTUCq+pjxwuFoiSZEX0Mhc2RstsguQiHA6bBfcFeU3Ww+c2sDDdsZxVt7af19SFdHKYZiEwskVV2yOGvLhxqFOUGl/ejom+HXlspJ5ljVOTbP/Wk/emFTG9U+g9Er9hA8fM7gfm5mCvwRkuV0QiJ67/X4Af8gT0DOvK8p/drtLciEtPlrBYRx9uYp1GZNoxxC2TMP/zL8b2cdeqJEJ3SM0EgmwAAA8C6NizSWwYSMM7yEbmkveA5ZsVody8r/FEFQqkvhoopTTxEgdrLhttCsTX2N3HBPdMdyJnvNlcCn8nLhY2MYh6/Luk9nNSOAzfbOOW123h5CufWVKZh9r32E/IZh9a2qv307GR+/gNG46+ermzv6muh9Y9tFzgBkD+njRaSNXupogdvokw7nzp2YA1yKMIhtMfE7hrjbeBbET6R7mFetb8QhGN4KcTFbu2grW+axQ8Bocbz8sqcafurVv/rVkXd0g+O0b2rc1YPdqcJyYEnWvnnCE4zJlxGUM86279nH5f96WZubzQMxwljEY3weeHPmfacS2yRrsdO1HwUYOdZG7XXdrvpGr0dKe9BdL4pBhGLV7FtzaDaZJzRKtsjFWXyYbs3V09hoQ03wHT0WG7yqN3KzpLWro7A/588XEEnGArEavUdvJF5ca1uzEN3VoAKQxvaks7UgRYUkP92tuZbN8vi1OFtER8fYe+W/fiFbtrKsJlJ11aCeoLTTtftHW2z8dS1eCjU+vP9tof0/TrYrvYIpHEpZG1DRpju7OJSnipcI2lTw3VaO+QqbmAdSWA9HFDeY1RIpA4kVBpqAuCgUk3ZCT6fzA9FXD3fN4KX0nfWfvW0GxO2D0O/PpeP74JlLetzc+Jq9CRWy2wkhen1ah81MpZvU9eJT7/yUpR2xUvl/Lnf28u27XK9wozDYpflDYEZHyHJ/S8CDDfs2vTb/tTfI82mOYLLH82RWKdwFW/XK5xGslFdLXVeIp3bf8vUCWFTW29Ox/nLG7Xw3kX78vEyuos5AqTu4eVUCMkrPW8dVPfSAzYs7Xh2wo/0bQtFwuU330p/Bd/MTfrfM7XitT9jMZMdfeAUtnLV2a5rRtcNP/Izs6nPQ7/RXc6yJw0J5bcTIXBC6adpnO4hkwlgyQnNWJ9GswK89va++JzKUDd4PczWEeDPdUsEoxm03N/boHMG5TxC/DDfSRwaMZ8xj8zRtQO+v2IcuexrTZAdlJAR6Bjy4ustcOfOJzV1Lt7hqWmYQuYoO97BCpY55ZmFkMjVZjGO8PLdm7yDOOAa2/U+eOh6wPlDpMqAFhbOR2Q7GQb5e9BFo5EPDnjVDB8RTQUSoIgHPNLqhfgiMTVdKZY5yS60NiJxvEQVS5VFZu77j97cfyp3HL/EQgpB+FNVh/RWhq6dLmUaz2U5ytW8n+dwGhanFCsHRwKTXc8wsv0NTbVEZDe5f73w+aEntbI0aCZRUIxfokR9AMVX2h6gbkThqf70anFQOflNpc4P+MV9rZpj57DcbNDDq0dZ4PIDJotT8x9q64I1uoz0Wf7mqL2e24H9j9eCGvqrifS08UgOLyHAXJGNa645PHU7Hfl08px5W9YZWASC+7s3J5O1KkbJxLku8leF1rpxmVfSxoo/U1/I3rOrG1n1NxqXmV4aBXOKpl/xiwGihhzwVNhwfu9ymHcWY4i5qFFvFW1jkcwh2wDFrwLo1qUyg5gItcJZcysbP1NLc1NqnQFHmno7CFGHEwkaHnNQJtRa8VnaawJOCRva+FJ+REsH2anvIMlI6aRDrLojALG9XykZjPcyDn3Pvj5WnUyWKxST0wGlwuDuC5gao9DC4EHb3LqC04Uvek312i4i+RX2b6KWX0JKJQbJYT9rpC8Y8GxZmE+HxhAv4cccbgyRKX7vMoc2Wx8OQWbovxJ9C6Vd93whfWrojh3Wcq0X5roIj1D6QokyU2OmKk9gDI/s3MQDqj/Id3ZV8HFL6QgMzuJoAAAEr/1swZ9x6gjYADWpAPZdkGqYnhRf81aYeOPhW26MOA71ksN7qvdqsFQKOqs7SPodfD/QYynJje+ez0fWQAJY/4gMNzaU+GXCJLtWpKNq3AazGEL8CNHvNEwqrj7pmsejTpV/qGnX903/mZHw/1efuUf8OnMHzQy4/xhzV9bzPETb7GN5sleh9qcpDawWltvrWnq3mO0z+zX+/R3gWEPLXIw4eMN5zUAAAGzrCoSokZ/5k465+BIkoMGhzgH/kHt+n5Is5ER+P/783CySZ6olWFMXIFt2k/c9+fTczbwVV3be0hocNAXzKjVKA4Z4JWQTXyrVpcnJH/fEM4IB60VXILF9uFVos3SqZvae7TziN/77oRCQ+0cXN9Krap/S704XfSboxiNx+a/T6KF4v1GOdvF58ctV5cX2WCEHSyeX+YNdSYc+oPoZ3TKVg93RBqkWc2/y5ke/6CBFra14l3w3w3qVkyWco4rjW5AALzSsxO4o3Svjw5fF3lMunDpWce21gCAOsZLKhyVqnfhWw9yAOCLlYN/rWZRVrTk7g7wgncF7vdg7lmH1dA3A4Ks0YP/XbVqZR++vch4rQfR/nKAJa7qVBvK8T3biHYhUbAp0KKskF9wLA5lrFUMzeBaRoj0mCYEEnQvJ8PVaIAcqaKbPYMn7FrKdSpWapfS9rrVZb5anCqoROS7vyOl3aT7LBrEWh1kf+ikJcJa34B3Vy8/yoo09pW48pxlSC3j4xYMyAk94BrlcLXEiPBBpn4I9GIxQvf2n63crKbmPOQRj4FiMlqDPIj3omoA1YE7k5tTlfHUlwwTg22TmEcwjmEcwjmEcwjmEcotlgxOHqAC2R91c5dif0ixd14RTBVVIjk+Bae322YziPmTufL2nE8h0qcRwbHWGH9G4euqr0JISQSFkloE9mig3C11z3xkovZUEWfJgu/uvJ5btuXGwLIfd7NvhV6fT/MrAgIIvFX+asuq9xBRqI9Yo36gfGMnJeZCXJGPyXDeoJ9uG5EpqH07kT1+DFHtX/WPvCA27eyewLgXJSQpX1FeDBxGLrZC9yNCej85T9rIGxfgoQKWmrvdpyJ5+cUY48y1ZRl5K9bJvy67hc4y6Q1ccPfRKFIXVAtinL5bVWCn+jAgl4NTCRzq20SY+iBsKsc1PiwjP510817MXa1y+DMclxsJpbPlRn/4f9JarYAAB+cY2AYUKIgJMPr/4B6Pzdvps+nD8B9C20e+0vggKUb349ZhCqKXYzJsHIoHMFLg5/sFLsWisyOH3bUP2NKjR50bROKq76SEWEePYB9yXBzoAAA0UNlsmPfGehtKnyLxVv1skz5xOsMT93fIwN6DEEhSrg2okpHUpx5jDpVspOns95PKdoJOGdlWNNCRCH641i4Gr2B4FXBmrmQyQeIgyAD50yWclBFmsYiN4aLq5Ior9T06oJ17BMGNiYRHTqQc/n1zHL7sKOoBKlZ9OFZ0LbIA0DBm36cvgAAJp3rINvjrx5Ky57AhHNp8cUPIr6iIY1AA8b0jprmGK1PRQW0+WjFiV9zXTmw4MvjlNE7K4YU0GPTjH0Ka2OjxooJPSMxW5303WrYGvQkABUfM1CcxK9mE/0KBq/KQhJArdp1YtI2JWwjm3J/CYPvHE62MTEBCHruJ8JRA8s5fjbTtRfzvvvwQo3980pJatYAAAoIpdASL0mOR7QT29vb29vb29vb29vb29vb29vb29vb29vb29vdiZC8RAAAA) **Sample Otel Log After Enrichment** ``` { resource:{ attributes:{ ec2_instance_id_aws:{ ##enrichment part companyId:32757 resourceId:i-0c352ce4c433c58a5 resourceType:aws:ec2:instance tags:{ tag_a:a tag_b:b } } cloud.availability_zone:us-east-1b cloud.platform:aws_ec2 cloud.provider:aws cloud.region:us-east-1 ec2_instance_id:i-01s32s14p423a98a5 host.image.id:ami-051f7e7f6c2f40dc1 host.name:ip-172-62-93-414.ec2.internal host.type:t2.micro } } scope:{ attributes:{} } resourceSchemaUrl: logRecord:{ attributes:{ log.file.name:log.log log.file.path:log.log } body:{ kubernetes:{ container_name:service-0 docker_id:12345186e060681175942786de75a102c679f13c3f0fb330231bdd94c5570e2 labels:{ app.kubernetes.io\\/managed-by:Helm statefulset.kubernetes.io\\/pod-name:service-0 } namespace_name:default pod_id:123456-aefb-456e-b315-77b014de9d5b pod_name:service-0 } log:[INFO] 2022-11-15T12:55:36,768 kafka.streams.processor.internals.StateDirectory service-0 stream-thread [categorization-0-CleanupThread] Deleting obsolete state directory 0_2 for task 0_2 as 32827574178ms has elapsed (cleanup delay is 600000ms). platform:aws_ec2 stream:stdout time:2022-11-15T12:55:36.768697532Z } observedTimeUnixNano:1694069570457198600 } } ``` ## Prerequisites[​](#prerequisites "Direct link to Prerequisites") * Coralogix [account](https://signup.coralogix.com/#/) set up in the [domain](https://docs-docusaurus.kinsta.page/user-guides/account-management/account-settings/coralogix-domain/.md) corresponding to the region where your data is stored * Coralogix [Send-Your-Data API key](https://docs-docusaurus.kinsta.page/user-guides/account-management/api-keys/send-your-data-api-key/.md) ## Setup[​](#setup "Direct link to Setup") ### Installation & configuration[​](#installation--configuration "Direct link to Installation & configuration") We **strongly recommend** installing and configuring with OpenTelemetry. The default example below uses the configuration for [OpenTelemetry](https://docs-docusaurus.kinsta.page/opentelemetry/getting-started/.md). 1 . Ensure your logs contain a key with EC2 instance ID value: | | | | ------------------------------------------------------------------------------------------------------------------------------ | -------------------------------------------------------------------------------------- | | ec2\_instance\_id | [OpenTelemetry](https://docs-docusaurus.kinsta.page/opentelemetry/getting-started/.md) | | instance\_id (default key name) using Fluent-plugin-ec2-metadata [plugin](https://github.com/takus/fluent-plugin-ec2-metadata) | [FluentD](https://docs-docusaurus.kinsta.page/integrations/files/fluentd/.md) | | ec2\_instance\_id | [Fluent Bit](https://docs-docusaurus.kinsta.page/integrations/files/fluent-bit/.md) | 2 . Add the resourcedetection and transform processors, enable the desired attributes, and add it to your config file. [FluentD metadata labels](https://github.com/takus/fluent-plugin-ec2-metadata) and [Fluent Bit metadata labels](https://docs.fluentbit.io/manual/pipeline/filters/aws-metadata) are configured differently. You must enable `host.id` for the enrichment to work. ### OpenTelemetry example[​](#opentelemetry-example "Direct link to OpenTelemetry example") ``` processors: resourcedetection: detectors: [ec2] override: true ec2: resource_attributes: host.id: enabled: true host.name: enabled: true host.image.id: enabled: true host.type: enabled: true cloud.region: enabled: true cloud.account.id: enabled: true cloud.availability_zone: enabled: true transform: error_mode: ignore log_statements: - context: log statements: - set(resource.attributes["ec2_instance_id"],resource.attributes["host.id"]) - delete_key(resource.attributes, "host.id") ``` ### Fluent Bit example[​](#fluent-bit-example "Direct link to Fluent Bit example") 1 . Add the AWS filter with the desired additional labels. ``` [FILTER] Name aws Match * ec2_instance_type true account_id true hostname true ``` 2 . Specify the desired AWS metadata labels under the nested filter as part of the nest operation defining root fields. ``` [FILTER] Name nest Match kube.* Operation nest Wildcard kubernetes Wildcard account_id Wildcard hostname Wildcard az Wildcard ec2_instance_type Wildcard ec2_instance_id Wildcard log Wildcard log_obj Wildcard stream Wildcard time Nest_under json ``` ### AWS Lambda deployment[​](#aws-lambda-deployment "Direct link to AWS Lambda deployment") 1 . Deploy the [AWS lambda function](https://serverlessrepo.aws.amazon.com/applications/eu-central-1/597078901540/Coralogix-Resource-Metadata) running in your AWS account. The platform collects logs from a chosen EC2 instance in your AWS account and sends them to Coralogix, enriching them with tags associated with your instance. 2 . Fill in the **Application settings** fields. * Input the Coralogix [domain](https://docs-docusaurus.kinsta.page/user-guides/account-management/account-settings/coralogix-domain/.md) within which your account has been created in **CoralogixRegion**. * Input your Coralogix [Send-Your-Data API key](https://docs-docusaurus.kinsta.page/user-guides/account-management/api-keys/send-your-data-api-key/.md) in **ApiKey**. * Do **not** change the default settings for the **FunctionMemorySize** and **FunctionTimeout.** [![](/assets/images/Untitled-21-1024x554-1f9dac35918b38a7faa6cfddf29df9cd.webp)](https://docs-docusaurus.kinsta.page/assets/images/Untitled-21-1024x554-1f9dac35918b38a7faa6cfddf29df9cd.webp) 3 . Deploy your application to collect tags. It will collect tags every 10 minutes and send them to Coralogix. ## AWS enrichment[​](#aws-enrichment "Direct link to AWS enrichment") 1 . Navigate to **Data Flow**, then **Data Enrichment**. Select **Enrich AWS metadata** to open the editor. 2 . Select the chosen AWS resource type. 3 . Select the key with your EC2 instance ID. | resource.attributes.ec2\_instance\_id | OpenTelemetry | | ------------------------------------- | ------------- | | ec2\_instance\_id | Fluent Bit | | instance\_id | Fluentd | **Note**: If you have modified the default option, you may have a different key. 4 . Add the enrichment. 5 . Logs associated with the chosen AWS resource should now appear enriched with AWS tags in your dashboard. To view them, navigate to **Explore** > **Logs** or to [LiveTail](https://docs-docusaurus.kinsta.page/user-guides/data_exploration/logs/livetail/.md). ## Limitations[​](#limitations "Direct link to Limitations") **AWS Resource Enrichment** feature grants the following: * Active resources (existing in the last 24h) / Coralogix team: 100,000 * 50 tags/resources (equal to AWS limits) * Tag key length <= 127 (equal to AWS limits) * Tag value length <= 255 (equal to AWS limits) ## Additional resources[​](#additional-resources "Direct link to Additional resources") | | | | ------ | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | | GitHub | [Lambda Documentation for Coralogix AWS Enrichment](https://github.com/coralogix/coralogix-aws-serverless/tree/master/src/resource-metadata)
[AWS: Coralogix-Resource-Metadata Application](https://serverlessrepo.aws.amazon.com/applications/eu-central-1/597078901540/Coralogix-Resource-Metadata) | ## Next steps[​](#next-steps "Direct link to Next steps") Add business, operational, or security context from CSV files with [Custom enrichment](https://docs-docusaurus.kinsta.page/user-guides/enrichment_rules/custom_enrichment/.md).