Shell Engine
This article mainly introduces the installation, usage and configuration of the Shell
engine plug-in in Linkis
.
1. Preliminary work
1.1 Environment installation
If you want to use the shell
engine on your server, you need to ensure that the user's PATH
has the executable directory and execution permission of bash
.
1.2 Environment verification
echo $SHELL
The following information is output to indicate that the shell environment is available
/bin/bash
or
/bin/sh
2. Engine plugin installation default engine
The Shell
engine plugin is included in the binary installation package released by linkis
by default, and users do not need to install it additionally.
EngineConnPlugin engine plugin installation
3. Engine usage
3.1 Submit tasks through Linkis-cli
sh ./bin/linkis-cli -engineType shell-1 \
-codeType shell -code "echo \"hello\" " \
-submitUser hadoop -proxyUser hadoop
More Linkis-Cli
command parameter reference: Linkis-Cli usage
3.2 Submit tasks through Linkis SDK
Linkis
provides SDK
for Java
and Scala
to submit tasks to the Linkis
server. For details, please refer to JAVA SDK Manual. For the Shell
task you only need to modify the EngineConnType
and CodeType
parameters in the Demo
:
Map<String, Object> labels = new HashMap<String, Object>();
labels.put(LabelKeyConstant.ENGINE_TYPE_KEY, "shell-1"); // required engineType Label
labels.put(LabelKeyConstant.USER_CREATOR_TYPE_KEY, "hadoop-IDE");// required execute user and creator
labels.put(LabelKeyConstant.CODE_TYPE_KEY, "shell"); // required codeType
4. Engine configuration instructions
The shell
engine can generally set the maximum memory of the engine JVM
.