Nats Jetsream

About JetStream

JetStream was created to solve the problems identified with streaming in technology today – complexity, fragility, and a lack of scalability. Some technologies address these better than others, but no current streaming technology is truly multi-tenant, horizontally scalable, and supports multiple deployment models. No technology we are aware of can scale from edge to cloud under the same security context while having complete deployment observability for operations.

Goals

JetStream was developed with the following goals in mind:

  • The system must be easy to configure and operate and be observable.
  • The system must be secure and operate well with NATS 2.0 security models.
  • The system must scale horizontally and be applicable to a high ingestion rate.
  • The system must support multiple use cases.
  • The system must self heal and always be available.
  • The system must have an API that is closer to core NATS.
  • The system must allow NATS messages to be part of a stream as desired.
  • The system must display payload agnostic behavior.
  • The system must not have third party dependencies.

High-Level Design and Features

In terms of deployment, a JetStream server is simply a NATS server with the JetStream subsystem enabled, launched with the -js flag with a configured server name and cluster name. From a client perspective, it does not matter which servers are running JetStream so long as there is some route to a JetStream enabled server or servers. This allows for a flexible deployment which to optimize resources for particular servers that will store streams versus very low overhead stateless servers, reducing OpEx and ultimately creating a scalable and manageable system.

Feature List

  • At-least-once delivery; exactly once within a window
  • Store messages and replay by time or sequence
  • Wildcard support
  • Account aware
  • Data at rest encryption
  • Cleanse specific messages (GDPR)
  • Horizontal scalability
  • Persist Streams and replay via Consumers

JetStream is designed to bifurcate ingestion and consumption of messages to provide multiple ways to consume data from the same stream. To that end, JetStream functionality is composed of server streams and server consumers.


Did You Know : Top 15 Free Online Learning Platforms

  1. Free Online Education Degrees : Coursera:

    Coursera partners with universities and organizations worldwide to offer a wide range of courses. While many courses are free, a fee is often required for certification.

  2. Free Online Education Degrees: edX:

    Founded by MIT and Harvard, edX offers high-quality courses from top universities and institutions around the world. Certificates are available for a fee.

  3. Free Online Education Degrees : Khan Academy:

    Khan Academy provides free educational content in various subjects, especially mathematics and science, using instructional videos and practice exercises.

  4. Free Online Education Degrees : Udacity:

    Udacity focuses on tech-related courses and nanodegree programs, offering free content as well as more in-depth paid programs.

  5. Free Online Education Degrees : MIT OpenCourseWare (OCW):

    MIT OCW provides a vast array of MIT's course content for free, covering a wide range of disciplines.

  6. Free Online Education Degrees : Harvard Extension School:

    Harvard Extension School offers a selection of free online courses. While some courses are free, others may require payment for a certificate.

  7. Free Online Education Degrees: Stanford Online:

    Stanford Online offers a variety of free courses in different disciplines, including computer science, engineering, and business.

  8. Best Free Online Courses : Carnegie Mellon Open Learning Initiative (OLI):

    OLI offers free online courses and resources designed to improve learning outcomes through research-based methodologies.

  9. Best Free Online Courses : FutureLearn:

    FutureLearn partners with universities and institutions to offer a diverse range of free online courses. Certificates are available for a fee.

  10. Best Free Online Courses: Alison:

    Alison offers a wide range of free online courses, including diploma and certificate programs, covering various subjects.

  11. Best Free Online Courses: Open Yale Courses:

    Yale University provides free access to a selection of introductory courses through Open Yale Courses.

  12. Best Free Online Courses : UC Berkeley Online:

    UC Berkeley offers free online courses on a variety of subjects, ranging from computer science to humanities.

  13. Best Free Online Courses : Google Digital Garage:

    Google Digital Garage provides free courses on digital skills, including online marketing, data analysis, and more.

  14. Best Free Online Courses : Codecademy:

    Codecademy offers free coding courses, interactive exercises, and coding projects to help individuals learn programming languages.

  15. Best Free Online Courses : LinkedIn Learning (formerly Lynda.com):

    LinkedIn Learning provides a variety of video courses on professional development, technology, and creative skills. It offers a free trial period.