一.環境準備
1.elasticsearch壓縮包、kibana插件、head-master插件,具體怎麼安裝配置,小夥伴們可以自行百度網上很多案例
可參考:https://blog.csdn.net/sinat_42338962/article/details/85227902
這裏說一下,國內下載一般都很慢,可以參考這篇文章,博主都放在百度雲,下載很方便
文章鏈接:https://blog.csdn.net/weixin_37281289/article/details/101483434
2.head插件使用,在elasticsearch-head-master根目錄下執行npm run start,訪問http://localhost:9100/即可查詢並操作ES中數據,
3.kibana使用。在kibana/bin文件夾下,執行kibana.bat,訪問http://localhost:5601/進行管理界面,在dev toos可進行操作數據,如下
4.查詢數據之前首先要創建索引和定義數據類型,比如你想存放哪些字段(時間,經緯度,部門等)
PUT hbp
{
"settings": {
"number_of_shards": 5,
"number_of_replicas": 1
},
"mappings": {
"properties": {
"id": {
"type": "text"
},
"name": {
"type": "text"
},
"dept": {
"type": "text"
},
"location":{
"type": "geo_point"
},
"pub_date":{
"type": "date",
"format": "yyyy-MM-dd HH:mm:ss||yyyy-MM-dd"
}
}
}
}
5.再用腳本新增數據,或者用java代碼連接es新增數據
PUT hbp/_doc/2
{
"name":"李四",
"pub_date":"2020-09-02 11:30:00",
"dept":"研發二部",
"location":{
"lat":39.669607,
"lon":118.257638
}
}
二:這裏重點講一下java根據距離範圍查詢並通過距離排序,當然下面代碼中也有其他的查詢和排序,僅供參考,這裏需要先在pom.xml引入依賴,注意版本號一致
org.elasticsearch.client elasticsearch-rest-high-level-client 7.3.2 org.elasticsearch elasticsearch 7.3.2
接下來直接上代碼
package com.zzht.esDemo;
import java.net.UnknownHostException;
import java.util.ArrayList;
import java.util.HashMap;
import java.util.List;
import java.util.Map;
import java.util.concurrent.TimeUnit;
import org.junit.Test;
import org.apache.http.HttpHost;
import org.elasticsearch.action.get.GetRequest;
import org.elasticsearch.action.get.GetResponse;
import org.elasticsearch.action.index.IndexRequest;
import org.elasticsearch.action.index.IndexResponse;
import org.elasticsearch.action.search.SearchRequest;
import org.elasticsearch.action.search.SearchResponse;
import org.elasticsearch.client.HttpAsyncResponseConsumerFactory;
import org.elasticsearch.client.RequestOptions;
import org.elasticsearch.client.RestClient;
import org.elasticsearch.client.RestHighLevelClient;
import org.elasticsearch.client.transport.TransportClient;
import org.elasticsearch.common.geo.GeoDistance;
import org.elasticsearch.common.settings.Settings;
import org.elasticsearch.common.transport.TransportAddress;
import org.elasticsearch.common.unit.DistanceUnit;
import org.elasticsearch.common.unit.TimeValue;
import org.elasticsearch.common.xcontent.XContentBuilder;
import org.elasticsearch.common.xcontent.XContentFactory;
import org.elasticsearch.index.query.BoolQueryBuilder;
import org.elasticsearch.index.query.GeoDistanceQueryBuilder;
import org.elasticsearch.index.query.GeoValidationMethod;
import org.elasticsearch.index.query.QueryBuilder;
import org.elasticsearch.index.query.QueryBuilders;
import org.elasticsearch.search.SearchHit;
import org.elasticsearch.search.SearchHits;
import org.elasticsearch.search.builder.SearchSourceBuilder;
import org.elasticsearch.search.sort.GeoDistanceSortBuilder;
import org.elasticsearch.search.sort.SortBuilders;
import org.elasticsearch.search.sort.SortOrder;
import org.elasticsearch.transport.client.PreBuiltTransportClient;
import java.io.IOException;
import java.net.InetAddress;
import java.net.UnknownHostException;
/**
* es測試
*
*/
public class EsDemo
{
private static final RequestOptions COMMON_OPTIONS;
static {
RequestOptions.Builder builder = RequestOptions.DEFAULT.toBuilder();
// 默認緩存限制爲100MB,此處修改爲30MB。
builder.setHttpAsyncResponseConsumerFactory(
new HttpAsyncResponseConsumerFactory
.HeapBufferedResponseConsumerFactory(30 * 1024 * 1024));
COMMON_OPTIONS = builder.build();
}
protected RestHighLevelClient client = new RestHighLevelClient(
RestClient.builder(new HttpHost("127.0.0.1", 9200, "http")));;
private String indexName = "hbp";
private String type = "_doc";
//從ES中查詢數據
@Test
public void test1() throws IOException {
Integer pageSize = 10;
Integer PageNum = 0;
SearchSourceBuilder searchSourceBuilder = new SearchSourceBuilder();
BoolQueryBuilder bq = QueryBuilders.boolQuery();
//按時間範圍查詢
QueryBuilder dateBuilder = QueryBuilders.rangeQuery("pub_date")
.gte("2020-09-01 10:30:00").lte("2020-09-02 13:50:00").format("yyyy-MM-dd HH:mm:ss");//時間範圍查詢
//根據id查詢
List<String> idList = new ArrayList<String>();
idList.add("1");
idList.add("2");
idList.add("3");
// idList.add("4");
// idList.add("5");
QueryBuilder idBuilder = QueryBuilders.termsQuery("_id", idList);
// 以某點爲中心,搜索指定範圍
GeoDistanceQueryBuilder distanceQueryBuilder = new GeoDistanceQueryBuilder("location");
distanceQueryBuilder.point(39.662263, 118.197815);
//查詢單位:km
distanceQueryBuilder.distance("6", DistanceUnit.KILOMETERS);
//構建檢索
/*這裏說明一下,distanceQueryBuilder就是距離查詢條件,idBuilder就是id過濾條件,
dateBuilder就是時間範圍查詢條件,可以定義一個或多個條件(QueryBuilder),下面的
排序也是同理,可以構造多個sortBuilder*/
QueryBuilder query = bq
// .filter(distanceQueryBuilder)
// .must(idBuilder)
.filter(dateBuilder)
;
searchSourceBuilder.query(query);
//按時間排序
// searchSourceBuilder.sort("pub_date", SortOrder.DESC);
//按距離排序
GeoDistanceSortBuilder distanceSort = SortBuilders.geoDistanceSort("location", 39.662263, 118.197815);
distanceSort.order(SortOrder.ASC);
distanceSort.geoDistance(GeoDistance.ARC);
distanceSort.unit(DistanceUnit.KILOMETERS);
distanceSort.validation(GeoValidationMethod.STRICT);
searchSourceBuilder.sort(distanceSort);
//查詢es數據
searchSourceBuilder.from(PageNum);
searchSourceBuilder.size(pageSize);
searchSourceBuilder.timeout(new TimeValue(100,TimeUnit.SECONDS));
SearchRequest searchRequest = new SearchRequest("hbp");
searchRequest.source(searchSourceBuilder);
SearchResponse response = client.search(searchRequest, RequestOptions.DEFAULT);
SearchHits hits = response.getHits();
for(SearchHit hit : hits){
System.out.println(hit.getSourceAsString());
System.out.println(hit.getSortValues()[0]);//獲取排序的距離,index爲排序的位置
}
//get方式數據查詢 ,參數爲Index,type和id
// GetRequest request = new GetRequest(indexName, "7");
// GetResponse getResponse1 = client.get(request, COMMON_OPTIONS);
// System.out.println(getResponse1.getSourceAsString());
client.close();
}
//插入數據
public void test2() throws IOException {
String jsonStr = "{"name":"開發004","pub_date":"2020-09-05 18:00:00","dept":"研發一部","location":{"lon":118.250192,"lat":39.691231}}";
IndexRequest request = new IndexRequest(indexName);
request.source(jsonStr, XContentType.JSON);
IndexResponse indexResponse = client.index(request, RequestOptions.DEFAULT);
System.out.println(indexResponse.getResult());
}
}
執行上面代碼的test1方法,輸出結果如下:
這個主要是根據經緯度來查詢某個點方圓半徑內的數據,比如附近5km內的餐館
另外貼下根據父文檔查詢子文檔代碼寫法
//父級查詢結果返回字段設置
// FetchSourceContext fetchSourceContext = new FetchSourceContext(true,new String[]{“formObject”},null);
// HasParentQueryBuilder parentCondition = JoinQueryBuilders.hasParentQuery(“procinst”, //父文檔type
// bqParent,false);//.innerHit(new InnerHitBuilder().setFetchSourceContext(fetchSourceContext));//設置父級(流程實例)返回字段
//
// queryChild.filter(parentCondition);
————————————————