PublicEnhencementService (PS) architecture design
PublicEnhancementService (PS): Public enhancement service, a module that provides functions such as unified configuration management, context service, physical library, data source management, microservice management, and historical task query for other microservice modules.
Introduction to the second-level module:
BML material library
It is the linkis material management system, which is mainly used to store various file data of users, including user scripts, resource files, third-party Jar packages, etc., and can also store class libraries that need to be used when the engine runs.
| Core Class | Core Function |
|---|---|
| UploadService | Provide resource upload service |
| DownloadService | Provide resource download service |
| ResourceManager | Provides a unified management entry for uploading and downloading resources |
| VersionManager | Provides resource version marking and version management functions |
| ProjectManager | Provides project-level resource management and control capabilities |
Unified configuration management
Configuration provides a "user-engine-application" three-level configuration management solution, which provides users with the function of configuring custom engine parameters under various access applications.
| Core Class | Core Function |
|---|---|
| CategoryService | Provides management services for application and engine catalogs |
| ConfigurationService | Provides a unified management service for user configuration |
ContextService context service
ContextService is used to solve the problem of data and information sharing across multiple systems in a data application development process.
| Core Class | Core Function |
|---|---|
| ContextCacheService | Provides a cache service for context information |
| ContextClient | Provides the ability for other microservices to interact with the CSServer group |
| ContextHAManager | Provide high-availability capabilities for ContextService |
| ListenerManager | The ability to provide a message bus |
| ContextSearch | Provides query entry |
| ContextService | Implements the overall execution logic of the context service |
Datasource data source management
Datasource provides the ability to connect to different data sources for other microservices.
| Core Class | Core Function |
|---|---|
| datasource-server | Provide the ability to connect to different data sources |
InstanceLabel microservice management
InstanceLabel provides registration and labeling functions for other microservices connected to linkis.
| Core Class | Core Function |
|---|---|
| InsLabelService | Provides microservice registration and label management functions |
Jobhistory historical task management
Jobhistory provides users with linkis historical task query, progress, log display related functions, and provides a unified historical task view for administrators.
| Core Class | Core Function |
|---|---|
| JobHistoryQueryService | Provide historical task query service |
Variable user-defined variable management
Variable provides users with functions related to the storage and use of custom variables.
| Core Class | Core Function |
|---|---|
| VariableService | Provides functions related to the storage and use of custom variables |
UDF user-defined function management
UDF provides users with the function of custom functions, which can be introduced by users when writing code.
| Core Class | Core Function |
|---|---|
| UDFService | Provide user-defined function service |