蓝鲸作业平台（Job）是一套运维基础操作管理系统，具备海量任务并发处理能力。除了支持脚本执行、文件分发、定时任务等一系列基础运维场景以外，还支持通过流程调度能力将零碎的单个任务组装成一个自动化作业流程；而每个作业都可做为一个原子节点，提供给上层或周边系统/平台使用，实现调度自动化。

缺陷场景: 在蓝鲸作业平台执行MySQL脚本的时候, 蓝鲸会通过内置的MySQL template脚本来执行用户上传的脚本。

脚本内有一个端口匹配的逻辑, 根据用户在作业平台传入的账号端口号去拼接MySQL的连接地址

跳转至问题代码

netstat -ntl | grep ${PORT} | awk '{print $4}'

因为grep为模糊匹配, 忽略了存在类似端口开启的可能, 例如MySQL的3306, 脚本还可以grep到33060,43306......, 导致最后拼接的MySQL连接地址异常, 从而导致脚本执行失败。

可以通过修改grep规则简单的修复问题：netstat -ntl | grep ":${PORT} " | awk '{print $4}'

随着7.0的到来，平台支持容器方式部署，理论上可以支持所有开发语言（包括Java）做SaaS开发。 但没有示例使用java开发SaaS——其中难点在于没有调用 API 的Java版SDK。 正好 bk-job 是java版的应用，里面有一些调用平台的jar。是否可以写一个文档，或做一个示例，让Java版的SaaS开发成为可能。

1. 按照与GSE讨论的灰度方案结果，简化调用GSE场景。第一种，如果走GSE1.0, 全部使用云区域+ipv4的方式，调用thrift；第二种，如果走GSE 2.0, 那么统一使用GSE 2.0 HTTP API, 传入真实的从cmdb拿到的bk_agent_id。
2. Job支持按照业务灰度对接GSE1.0/2.0(按任务权重对接影响范围较大，咱不提供）
3. 考虑到agent状态查询、任务下发、结果查询之间的关联性，对于同一个任务来说，需要调用同一个GSE。处理如下: 在TaskExecuteServiceImpl中就根据特性开关确定使用GSE1.0/2.0。如果用GSE1.0,那么设置agentId为{云区域ID:IPv4}这种兼容模式；如果用GSE2.0，那么设置agentId为真实的从cmdb获取到的bk_agent_id属性。后续的Agent状态查询/任务下发，根据agentId的版本选择下发的GSE.
4. 查询GSE任务结果使用GSE_TASK_ID判定版本（跟GSE预定，他们2.0的TASK_ID以GSE:V2:开头）
5. 重构特性开关能力，并支持通过/actuator/refresh endpoint 动态刷新配置并处理配置刷新事件（EnvironmentChangeEvent)
6. 支持动态刷新配置的能力，见 #1620 ，开发中

Version / Branch / tag ≥3.5.1

出了什么问题？(What Happened?)

这个规则 del /f /s /q C:\tmp 竟然没有正确命中

如何复现？(How to reproduce?) 使用 bat 脚本的这个高位表达式 del /f /s /q C:\tmp

预期结果(What you expect?) 应该要命中才对

Version / Branch / tag 3.5.x

出了什么问题？(What Happened?) 全局设置消息预览在发送失败的情况下仍提示发送成功

如何复现？(How to reproduce?) 全局设置消息预览，选择正确的人员与异常的消息通道发送消息进行预览

预期结果(What you expect?) 在发送失败的情况下提示发送失败

我想对bk-job做二开，但是在idea启动后，除了job-config可以正常启动外，别的项目都报如下错误： [2022-06-26 16:37:45.044] ERROR [,,] 8052 --- [main] o.s.boot.SpringApplication : Application run failed

org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'interceptorConfiguration' defined in file [E:\SoftwareProject\bk-job\src\backend\job-manage\boot-job-manage\build\classes\java\main\com\tencent\bk\job\manage\config\InterceptorConfiguration.class]: Unsatisfied dependency expressed through constructor parameter 5; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'serviceSecurityInterceptor' defined in URL [jar:file:/E:/SoftwareProject/bk-job/src/backend/commons/common-web/build/libs/common-web-1.0.0.jar!/com/tencent/bk/job/common/web/interceptor/ServiceSecurityInterceptor.class]: Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'jwtManager' defined in class path resource [com/tencent/bk/job/common/security/autoconfigure/ServiceSecurityAutoConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [com.tencent.bk.job.common.util.jwt.JwtManager]: Factory method 'jwtManager' threw exception; nested exception is java.io.IOException: Perm content is empty at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:800) at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:229) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1354) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1204) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:564) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:524) at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:335) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:333) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:208) at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:944) at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:918) at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:583) at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:144) at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:771) at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:763) at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:438) at org.springframework.boot.SpringApplication.run(SpringApplication.java:339) at org.springframework.boot.SpringApplication.run(SpringApplication.java:1329) at org.springframework.boot.SpringApplication.run(SpringApplication.java:1318) at com.tencent.bk.job.manage.JobManageBootApplication.main(JobManageBootApplication.java:54) Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'serviceSecurityInterceptor' defined in URL [jar:file:/E:/SoftwareProject/bk-job/src/backend/commons/common-web/build/libs/common-web-1.0.0.jar!/com/tencent/bk/job/common/web/interceptor/ServiceSecurityInterceptor.class]: Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'jwtManager' defined in class path resource [com/tencent/bk/job/common/security/autoconfigure/ServiceSecurityAutoConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [com.tencent.bk.job.common.util.jwt.JwtManager]: Factory method 'jwtManager' threw exception; nested exception is java.io.IOException: Perm content is empty at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:800) at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:229) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1354) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1204) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:564) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:524) at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:335) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:333) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:208) at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:276) at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1380) at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1300) at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:887) at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:791) ... 20 common frames omitted Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'jwtManager' defined in class path resource [com/tencent/bk/job/common/security/autoconfigure/ServiceSecurityAutoConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [com.tencent.bk.job.common.util.jwt.JwtManager]: Factory method 'jwtManager' threw exception; nested exception is java.io.IOException: Perm content is empty at org.springframework.beans.factory.support.ConstructorResolver.instantiate(ConstructorResolver.java:658) at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:638) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:1334) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1177) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:564) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:524) at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:335) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234) at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:333) at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:208) at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:276) at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1380) at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1300) at org.springframework.beans.factory.support.ConstructorResolver.resolveAutowiredArgument(ConstructorResolver.java:887) at org.springframework.beans.factory.support.ConstructorResolver.createArgumentArray(ConstructorResolver.java:791) ... 34 common frames omitted Caused by: org.springframework.beans.BeanInstantiationException: Failed to instantiate [com.tencent.bk.job.common.util.jwt.JwtManager]: Factory method 'jwtManager' threw exception; nested exception is java.io.IOException: Perm content is empty at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:185) at org.springframework.beans.factory.support.ConstructorResolver.instantiate(ConstructorResolver.java:653) ... 48 common frames omitted Caused by: java.io.IOException: Perm content is empty at com.tencent.bk.job.common.util.crypto.RSAUtils.getPermKey(RSAUtils.java:85) at com.tencent.bk.job.common.util.crypto.RSAUtils.getPrivateKey(RSAUtils.java:108) at com.tencent.bk.job.common.util.jwt.BasicJwtManager.(BasicJwtManager.java:56) at com.tencent.bk.job.common.security.jwt.AutoUpdateJwtManager.(AutoUpdateJwtManager.java:14) at com.tencent.bk.job.common.security.autoconfigure.ServiceSecurityAutoConfiguration.jwtManager(ServiceSecurityAutoConfiguration.java:50) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:154) ... 49 common frames omitted

版本/分支/tag 3.4.3 问题描述 执行高危脚本检查的时候，后台报错

Caused by: java.lang.ArrayIndexOutOfBoundsException: 39
        at com.tencent.bk.job.manage.manager.script.check.checker.DefaultChecker.checkScriptLines(DefaultChecker.java:65)
        at com.tencent.bk.job.manage.manager.script.check.checker.DefaultChecker.checkScriptLines(DefaultChecker.java:52)
        at com.tencent.bk.job.manage.manager.script.check.checker.ScriptLogicChecker.call(ScriptLogicChecker.java:70)
        at com.tencent.bk.job.manage.manager.script.check.checker.ScriptLogicChecker.call(ScriptLogicChecker.java:44)

如何复现 当脚本内容最后一行为#开头的时候。比如：

#!/bin/bash

anynowtime="date +'%Y-%m-%d %H:%M:%S'"
NOW="echo [\`$anynowtime\`][PID:$$]"

##### 可在脚本开始运行时调用，打印当时的时间戳及PID。
function job_start
{
    echo "`eval $NOW` job_start"
}

##### 可在脚本执行成功的逻辑分支处调用，打印当时的时间戳及PID。
function job_success
{
    MSG="$*"
    echo "`eval $NOW` job_success:[$MSG]"
    exit 0
}

##### 可在脚本执行失败的逻辑分支处调用，打印当时的时间戳及PID。
function job_fail
{
    MSG="$*"
    echo "`eval $NOW` job_fail:[$MSG]"
    exit 1
}

job_start

###### 作业平台中执行脚本成功和失败的标准只取决于脚本最后一条执行语句的返回值
###### 如果返回值为0，则认为此脚本执行成功，如果非0，则认为脚本执行失败
###### 可在此处开始编写您的脚本逻辑代码

预期结果 后台不报错

• 问题描述 执行方案步骤包含全局可变变量，“失败ip重试”的时候任务一直处理正在运行中，且无法终止。

• 后台错误： org.jooq.exception.DataAccessException: SQL [insert into job_execute.step_instance_variable (task_instance_id, step_instance_id, execute_count, type, param_values) values (?, ?, ?, ?, ?)]; Duplicate entry '30094846266-0-1' for key 'uk_step_instance_id_execute_count_type'

Version / Branch / tag

3.5.2-beta.1

出了什么问题？(What Happened?)

调用接口进行文件分发，传输模式选择严谨模式，但执行后却是强制模式。

如何复现？(How to reproduce?)

按问题描述即可复现

预期结果(What you expect?) transfer_mode参数生效

Version / Branch / tag

3.5.x-3.7.x

出了什么问题？(What Happened?)

job-gateway 模块 actuator endpoint 缺少认证

如何复现？(How to reproduce?)

curl http://localhost:19876/actuator/beans 等，无需认证即可获取到数据

预期结果(What you expect?)

job-gateway 模块 actuator endpoint 需要加上认证

需求背景

当执行目标主机和执行账户不对等时（如windows主机用linux账号），可能会导致执行失败（因为windows的用户账号执行时需要密码，而linux不用）；希望在用户选择完执行目标后，JOB可以聪明的判断执行目标主机的OS类型，给出明确的提醒和指引让用户确认是否需要更改执行账号，避免执行后失败再重来。

需求描述

Version / Branch / tag

出了什么问题？(What Happened?)

• 目标主机为IPv6, 作业执行详情-导出日志的主机ip信息显示为null

如何复现？(How to reproduce?)

见问题描述

预期结果(What you expect?)

1. 优先输出IPv4主机；如果不存在，输出IPv6

Version / Branch / tag

3.7.x

出了什么问题？(What Happened?) 如果目标主机只有IPv6地址，使用JOB_LAST_SUCCESS/JOB_LAST_FAIL/JOB_LAST_ALL魔法变量输出变量值，变量值=null

如何复现？(How to reproduce?)

见问题描述

预期结果(What you expect?)

1. 如果存在IPv4地址，优先使用IPv4; 否则使用IPv6地址