Easy-es - easy use for elastich search

 LambdaEsQueryWrapper<Demo> wrapper = new LambdaEsQueryWrapper<>();
 wrapper.like(Demo::getMessage, demoDto.getMessage())
               .eq(Demo::getUserName, demoDto.getUserName())
              ...
demoMapper.selectList(wrapper);

比如这个 demoDto.getUserName() 的值为张三，es中是存在userName为张三的数据的，但是无法查询出来

除了利用原生的语句，可以用wrapper的方式根据嵌套对象里的字段排序吗，没有找到对应的方法

OrderByParam order = new OrderByParam(); order.setOrder("student.age"); wrapper.orderByDesc("student.age"); 用这种方式没有效果，不能排序

两个实体：

@Data @IndexName(value = "content_index",shardsNum = 1,replicasNum = 2) public class Content {

@IndexId(type = IdType.CUSTOMIZE)
private String indexId;

/**
 * 这个字段没有存进去，在研究
 */
@IndexField("id")
private Long id;

@IndexField(value = "title")
private String title;

/**
 * 将时间格式化，并转为中国时区
 */
@JsonFormat(pattern = "yyyy-MM-dd HH:mm:ss", timezone = "GMT+8")
private Date planEndTime;

private Integer tplId;


@IndexField(value = "student",fieldType = FieldType.OBJECT)
private Student student;

// @IndexField(value = "students",fieldType = FieldType.ARRAY) // private List students;

public void setId(Long id) {
    this.id = id;
    this.indexId = id.toString();
}

}

@Data @AllArgsConstructor @NoArgsConstructor public class Student {

private String name;

private Integer age;

@JsonFormat(pattern = "yyyy-MM-dd HH:mm:ss", timezone = "GMT+8")
private Date dirthday;

}

报错内容： 12:56:51.371 [http-nio-8080-exec-1] ERROR o.a.c.c.C.[.[.[.[dispatcherServlet] - Servlet.service() for servlet [dispatcherServlet] in context with path [] threw exception [Request processing failed; nested exception is java.lang.reflect.UndeclaredThrowableException] with root cause java.lang.NullPointerException: null at com.alibaba.fastjson.serializer.SerializeWriter.writeFieldValueStringWithDoubleQuoteCheck(SerializeWriter.java:1869) at com.alibaba.fastjson.serializer.SerializeWriter.writeFieldValue(SerializeWriter.java:1854) at com.alibaba.fastjson.serializer.ASMSerializer_2_Student.writeNormal(Unknown Source) at com.alibaba.fastjson.serializer.ASMSerializer_2_Student.write(Unknown Source) at com.alibaba.fastjson.serializer.ASMSerializer_1_Content.writeNormal(Unknown Source) at com.alibaba.fastjson.serializer.ASMSerializer_1_Content.write(Unknown Source) at com.alibaba.fastjson.serializer.JSONSerializer.write(JSONSerializer.java:312) at com.alibaba.fastjson.JSON.toJSONString(JSON.java:769) at com.alibaba.fastjson.JSON.toJSONString(JSON.java:707) at cn.easyes.core.conditions.BaseEsMapperImpl.buildJsonIndexSource(BaseEsMapperImpl.java:1132) at cn.easyes.core.conditions.BaseEsMapperImpl.buildIndexRequest(BaseEsMapperImpl.java:855) at cn.easyes.core.conditions.BaseEsMapperImpl.doInsert(BaseEsMapperImpl.java:546) at cn.easyes.core.conditions.BaseEsMapperImpl.lambda$insert$7(BaseEsMapperImpl.java:266) at java.base/java.util.stream.ReferencePipeline$4$1.accept(ReferencePipeline.java:212) at java.base/java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948) at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484) at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474) at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913) at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) at java.base/java.util.stream.IntPipeline.reduce(IntPipeline.java:491) at java.base/java.util.stream.IntPipeline.sum(IntPipeline.java:449) at cn.easyes.core.conditions.BaseEsMapperImpl.insert(BaseEsMapperImpl.java:267) at cn.easyes.core.conditions.BaseEsMapperImpl.insert(BaseEsMapperImpl.java:257) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at cn.easyes.core.proxy.EsMapperProxy.invoke(EsMapperProxy.java:28) at com.sun.proxy.$Proxy57.insert(Unknown Source) at com.hhf.controller.TestController.t1(TestController.java:56) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1067) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:963) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:898) at javax.servlet.http.HttpServlet.service(HttpServlet.java:655) at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) at javax.servlet.http.HttpServlet.service(HttpServlet.java:764) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:227) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:197) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:540) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:135) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:357) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:382) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:895) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1732) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.base/java.lang.Thread.run(Thread.java:834)

@Data @IndexName(value = "rmrb_live_info_test_s1") public class Content {

@IndexField("id")
@IndexId(type = IdType.CUSTOMIZE)
private Long id;

private String title;

private Date planEndTime;

private Integer tplId;

}

我实体类是这样写的，id即使主键又是索引数据的一个字段，我这样写，只能把id设置成主键，索引数据中没有id这个字段，请问怎么设置呢

读最新的文档，发现官方也已经支持类似的功能了 https://www.elastic.co/guide/en/elasticsearch/reference/current/sql-getting-started.html POST /_sql?format=txt { "query": "SELECT * FROM library WHERE release_date < '2000-01-01'" }

在insert保存的时候，由于当前需要存储的字段被标记为高亮，在insert时，被标记为高亮字段所在列被忽略，导致序列化过程中出现空指异常。为什么需要插入的时候需要把高亮字段忽略，没太明白作者的意图，我理解不应该忽略该内容，如果需要忽略也是按照具体序列化方式，或者把序列化方式的操作抽象为接口，可以让使用者自己选择

• In ElasticSearch 8.x, TLS and user authentication are enabled by default, can the developer suggest how to set http_ca.crt at https://github.com/xpc1024/easy-es-springboot-demo ?

• Here are two blog posts about how to connect via TLS certificate under co.elastic.clients:elasticsearch-java:8.1.1, but it would be better if some friends can give the introduction of global configuration of TLS certificate in easy-es (Maybe in application.yml). Refer to https://www.elastic.co/guide/en/elasticsearch/client/java-api-client/8.1/_encrypted_communication.html and https://spinscale.de/posts/2022-02-17-running-elasticsearch-8-with-testcontainers.html .

• I noticed that the component is using RestHighLevelClient, which means that if somebody need to connect to the ElasticSearch 8.x cluster, he need to add the environment variable ELASTIC_CLIENT_APIVERSIONING: true for ElasticSearch. For this part, please refer to https://www.elastic.co/guide/en/elasticsearch/reference/current/rest-api-compatibility.html . Hope that helps with the corresponding tests.

• As a supplement, developers should try adding a property set to HLRC's client.setApiCompatibilityMode(true) in the easy-es configuration class. See https://github.com/elastic/elasticsearch/issues/77859, which helps in finding issues with unit tests in Elastic Stack 8.x versions without setting client-side environment variables.

• Also, there is a clarification as https://discuss.elastic.co/t/migration-from-hlrc-to-java-api/300479 , HLRC version 7.17.1 and Java API client 8.x, both use the same RestClient for http communication, and they can coexist in the same project, I think it can be gradually migrated to the new client on easy-es. Of course, the Java API client 8.x is basically generated by the API specification, This leads to the fact that although its API is stable, its documentation is still not finished, and somebody need to go to JavaDoc to see more information.

Description

Auto index only cover TEXT or KEYWORD, do we have the possible to support wildcard? For current version, I have to set manual index-mode and manually create index for wildcard.

Expect Sample

@IndexField(fieldType = FieldType.WILDCARD)
private String content;

Then it will auto create index as type wildcard

Reference

https://www.elastic.co/guide/en/elasticsearch/reference/7.17/keyword.html#wildcard-field-type

请求支持场景： 业务数据使用MySQL存储，ES只做搜索，这样就需要支持MySQL数据同步到ES； MySQL设计表结构一般遵循三范式、ES索引结构却支持多层级JSON，故一般SQL主表一条记录对应ES一个文档、SQL主表的关联表对应ES文档下的一个JSON，如：

create table student
(
    id   bigint unsigned auto_increment
        primary key,
    name varchar(32) not null comment '名称'
);
create table course
(
    id   bigint unsigned auto_increment
        primary key,
    name varchar(32) not null comment '名称'
);
create table student_course
(
    id         bigint unsigned auto_increment
        primary key,
    student_id bigint not null comment '学生id',
    course_id  bigint not null comment '课程id'
);

对应ES的数据应该是：

{
  "_id": 1,
  "name": "学生名称",
  "course": [
    {
      "course_id": 1,
      "name": "课程名称"
    }
  ]
}

请求支持此种数据同步，业界方案一般是使用读binlog、表和文档字段映射关系配置来实现，但自己实现起来会遇到各种问题，如：拓展性不够、容灾性不高、数据会丢失、同步会卡住、同步延迟大、SQL改动后会涉及到重建索引 一直没有一个好用的、开源的、易入手的框架工具来解决这个事情，看了作者大大的EE索引维护方案，希望作者大大能够考虑这种场景，出一个解决方案

ERROR 49888 --- [ main] easy-es : Easy-Es supported elasticsearch and restHighLevelClient jar version is:7.14.0 ,Please resolve the dependency conflict!

如题，ERROR 改为 WARNING，分析日志总是看到，很烦。

LambdaWrapper 构建条件的时候，Lambda 表达式对应的字段名称缓存。

@Test
public void testSelect() {
    // 测试查询
    String title = "老汉";
    LambdaEsQueryWrapper<Document> wrapper = new LambdaEsQueryWrapper<>();
    wrapper.eq(Document::getTitle,title);
    Document document = documentMapper.selectOne(wrapper);
    System.out.println(document);
    Assert.assertEquals(title,document.getTitle());
}

e.g. Document::getTitle -> title 第二次使用的时候，直接使用第一次生成好的缓存。