springcloud的configserver配置中心默認中文亂碼的解決方法

springcloud的configserver配置中心默認中文亂碼的解決方法

先表明我的springcloud版本（2021.0.6）和對應springboot版本（2.6.14）

Release Train Version: 2021.0.6

Supported Boot Version: 2.6.14

https://docs.spring.io/spring-cloud/docs/2021.0.6/reference/html/

 

問題描述：

當從遠端拉取的properties配置文件中含有中文，呈現亂碼

產生原因：

spring 中默認使用PropertiesPropertySourceLoader進行properties文件解析，在解析過程會利用OriginTrackedPropertiesLoader創建CharacterReader, 而問題就出現在這個CharacterReader身上，內部指定了ISO_8859_1編碼，導致解析中文亂碼！

解決方法：

對於spring cloud config組件由兩部分組成，分別是configServer和configClient，configClient向configServer發起配置請求，configServer從github上拉取配置並在本地緩存，而後對配置文件進行解析，最後將配置發送個configClient, 所以，問題主要解決點在configServer方！。

 

注意：下述操作在configServer方!!!

創建兩個自定義對象，分別是CustomizedOriginTrackedPropertiesLoader和CustomizedPropertiesPropertySourceLoader分別對應源碼的OriginTrackedPropertiesLoader和PropertiesPropertySourceLoader，可以對着源碼直接ctrl+cv,而後改一下名字，即可，兩者放在同一包，OriginTrackedPropertiesLoader訪問權限默認是包私有，自定義的可以改!

注意：爲了讓自定義的CustomizedPropertiesPropertySourceLoader優先級高於系統自帶的PropertiesPropertySourceLoader,需要添加@Order註解，系統默認優先級最低(2147483647)，我們直接Ordered.LOWEST_PRECEDENCE - 1

 

我這裏是在configserver應用創建了一個encode的子包

 

CustomizedPropertiesPropertySourceLoader.java

package com.imddysc.configserver.encode;


import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
import org.springframework.boot.env.OriginTrackedMapPropertySource;
//import org.springframework.boot.env.OriginTrackedPropertiesLoader;
import org.springframework.boot.env.PropertySourceLoader;
import org.springframework.core.Ordered;
import org.springframework.core.annotation.Order;
import org.springframework.core.env.PropertySource;
import org.springframework.core.io.Resource;
import org.springframework.core.io.support.PropertiesLoaderUtils;

import java.io.IOException;
import java.util.ArrayList;
import java.util.Collections;
import java.util.List;
import java.util.Map;

@Order(Ordered.LOWEST_PRECEDENCE - 1)
public class CustomizedPropertiesPropertySourceLoader implements PropertySourceLoader {
    private static final Logger logger = LoggerFactory.getLogger(CustomizedPropertiesPropertySourceLoader.class);


    private static final String XML_FILE_EXTENSION = ".xml";

    @Override
    public String[] getFileExtensions() {
        return new String[] { "properties", "xml" };
    }

    @Override
    public List<PropertySource<?>> load(String name, Resource resource) throws IOException {
        List<Map<String, ?>> properties = loadProperties(resource);
        if (properties.isEmpty()) {
            return Collections.emptyList();
        }
        List<PropertySource<?>> propertySources = new ArrayList<>(properties.size());
        for (int i = 0; i < properties.size(); i++) {
            String documentNumber = (properties.size() != 1) ? " (document #" + i + ")" : "";
            propertySources.add(new OriginTrackedMapPropertySource(name + documentNumber,
                    Collections.unmodifiableMap(properties.get(i)), true));
        }
        return propertySources;
    }

    @SuppressWarnings({ "unchecked", "rawtypes" })
    private List<Map<String, ?>> loadProperties(Resource resource) throws IOException {
        String filename = resource.getFilename();
        List<Map<String, ?>> result = new ArrayList<>();
        if (filename != null && filename.endsWith(XML_FILE_EXTENSION)) {
            result.add((Map) PropertiesLoaderUtils.loadProperties(resource));
        }
        else {
            List<CustomizedOriginTrackedPropertiesLoader.Document> documents = new CustomizedOriginTrackedPropertiesLoader(resource).load();
            documents.forEach((document) -> result.add(document.asMap()));
        }
        return result;
    }

}

 

CustomizedOriginTrackedPropertiesLoader.java

package com.imddysc.configserver.encode;

import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
//import org.springframework.boot.env.OriginTrackedPropertiesLoader;
import org.springframework.boot.origin.Origin;
import org.springframework.boot.origin.OriginTrackedValue;
import org.springframework.boot.origin.TextResourceOrigin;
import org.springframework.core.io.Resource;
import org.springframework.util.Assert;

import java.io.Closeable;
import java.io.IOException;
import java.io.InputStreamReader;
import java.io.LineNumberReader;
import java.nio.charset.StandardCharsets;
import java.util.ArrayList;
import java.util.LinkedHashMap;
import java.util.List;
import java.util.Map;
import java.util.function.BooleanSupplier;

public class CustomizedOriginTrackedPropertiesLoader {
    private static final Logger logger = LoggerFactory.getLogger(CustomizedOriginTrackedPropertiesLoader.class);

    private final Resource resource;

    /**
     * Create a new {@link OriginTrackedPropertiesLoader} instance.
     * @param resource the resource of the {@code .properties} data
     */
    CustomizedOriginTrackedPropertiesLoader(Resource resource) {
        Assert.notNull(resource, "Resource must not be null");
        this.resource = resource;
    }

    /**
     * Load {@code .properties} data and return a list of documents.
     * @return the loaded properties
     * @throws IOException on read error
     */
    List<CustomizedOriginTrackedPropertiesLoader.Document> load() throws IOException {
        return load(true);
    }

    /**
     * Load {@code .properties} data and return a map of {@code String} ->
     * {@link OriginTrackedValue}.
     * @param expandLists if list {@code name[]=a,b,c} shortcuts should be expanded
     * @return the loaded properties
     * @throws IOException on read error
     */
    List<CustomizedOriginTrackedPropertiesLoader.Document> load(boolean expandLists) throws IOException {
        List<CustomizedOriginTrackedPropertiesLoader.Document> documents = new ArrayList<>();
        CustomizedOriginTrackedPropertiesLoader.Document document = new CustomizedOriginTrackedPropertiesLoader.Document();
        StringBuilder buffer = new StringBuilder();
        try (CustomizedOriginTrackedPropertiesLoader.CharacterReader reader = new CustomizedOriginTrackedPropertiesLoader.CharacterReader(this.resource)) {
            while (reader.read()) {
                if (reader.isCommentPrefixCharacter()) {
                    char commentPrefixCharacter = reader.getCharacter();
                    if (isNewDocument(reader)) {
                        if (!document.isEmpty()) {
                            documents.add(document);
                        }
                        document = new CustomizedOriginTrackedPropertiesLoader.Document();
                    }
                    else {
                        if (document.isEmpty() && !documents.isEmpty()) {
                            document = documents.remove(documents.size() - 1);
                        }
                        reader.setLastLineCommentPrefixCharacter(commentPrefixCharacter);
                        reader.skipComment();
                    }
                }
                else {
                    reader.setLastLineCommentPrefixCharacter(-1);
                    loadKeyAndValue(expandLists, document, reader, buffer);
                }
            }

        }
        if (!document.isEmpty() && !documents.contains(document)) {
            documents.add(document);
        }
        return documents;
    }

    private void loadKeyAndValue(boolean expandLists, CustomizedOriginTrackedPropertiesLoader.Document document, CustomizedOriginTrackedPropertiesLoader.CharacterReader reader, StringBuilder buffer)
            throws IOException {
        String key = loadKey(buffer, reader).trim();
        if (expandLists && key.endsWith("[]")) {
            key = key.substring(0, key.length() - 2);
            int index = 0;
            do {
                OriginTrackedValue value = loadValue(buffer, reader, true);
                document.put(key + "[" + (index++) + "]", value);
                if (!reader.isEndOfLine()) {
                    reader.read();
                }
            }
            while (!reader.isEndOfLine());
        }
        else {
            OriginTrackedValue value = loadValue(buffer, reader, false);
            document.put(key, value);
        }
    }

    private String loadKey(StringBuilder buffer, CustomizedOriginTrackedPropertiesLoader.CharacterReader reader) throws IOException {
        buffer.setLength(0);
        boolean previousWhitespace = false;
        while (!reader.isEndOfLine()) {
            if (reader.isPropertyDelimiter()) {
                reader.read();
                return buffer.toString();
            }
            if (!reader.isWhiteSpace() && previousWhitespace) {
                return buffer.toString();
            }
            previousWhitespace = reader.isWhiteSpace();
            buffer.append(reader.getCharacter());
            reader.read();
        }
        return buffer.toString();
    }

    private OriginTrackedValue loadValue(StringBuilder buffer, CustomizedOriginTrackedPropertiesLoader.CharacterReader reader, boolean splitLists)
            throws IOException {
        buffer.setLength(0);
        while (reader.isWhiteSpace() && !reader.isEndOfLine()) {
            reader.read();
        }
        TextResourceOrigin.Location location = reader.getLocation();
        while (!reader.isEndOfLine() && !(splitLists && reader.isListDelimiter())) {
            buffer.append(reader.getCharacter());
            reader.read();
        }
        Origin origin = new TextResourceOrigin(this.resource, location);
        return OriginTrackedValue.of(buffer.toString(), origin);
    }

    private boolean isNewDocument(CustomizedOriginTrackedPropertiesLoader.CharacterReader reader) throws IOException {
        if (reader.isSameLastLineCommentPrefix()) {
            return false;
        }
        boolean result = reader.getLocation().getColumn() == 0;
        result = result && readAndExpect(reader, reader::isHyphenCharacter);
        result = result && readAndExpect(reader, reader::isHyphenCharacter);
        result = result && readAndExpect(reader, reader::isHyphenCharacter);
        if (!reader.isEndOfLine()) {
            reader.read();
            reader.skipWhitespace();
        }
        return result && reader.isEndOfLine();
    }

    private boolean readAndExpect(CustomizedOriginTrackedPropertiesLoader.CharacterReader reader, BooleanSupplier check) throws IOException {
        reader.read();
        return check.getAsBoolean();
    }

    /**
     * Reads characters from the source resource, taking care of skipping comments,
     * handling multi-line values and tracking {@code '\'} escapes.
     */
    private static class CharacterReader implements Closeable {

        private static final String[] ESCAPES = { "trnf", "\t\r\n\f" };

        private final LineNumberReader reader;

        private int columnNumber = -1;

        private boolean escaped;

        private int character;

        private int lastLineCommentPrefixCharacter;

        CharacterReader(Resource resource) throws IOException {
            logger.info("-----顯示這行就代表加載了UTF來解析對應的Resource代指的properties文件----------------------------------------------------");
            this.reader = new LineNumberReader(
                    new InputStreamReader(resource.getInputStream(), StandardCharsets.UTF_8));
        }

        @Override
        public void close() throws IOException {
            this.reader.close();
        }

        boolean read() throws IOException {
            this.escaped = false;
            this.character = this.reader.read();
            this.columnNumber++;
            if (this.columnNumber == 0) {
                skipWhitespace();
            }
            if (this.character == '\\') {
                this.escaped = true;
                readEscaped();
            }
            else if (this.character == '\n') {
                this.columnNumber = -1;
            }
            return !isEndOfFile();
        }

        private void skipWhitespace() throws IOException {
            while (isWhiteSpace()) {
                this.character = this.reader.read();
                this.columnNumber++;
            }
        }

        private void setLastLineCommentPrefixCharacter(int lastLineCommentPrefixCharacter) {
            this.lastLineCommentPrefixCharacter = lastLineCommentPrefixCharacter;
        }

        private void skipComment() throws IOException {
            while (this.character != '\n' && this.character != -1) {
                this.character = this.reader.read();
            }
            this.columnNumber = -1;
        }

        private void readEscaped() throws IOException {
            this.character = this.reader.read();
            int escapeIndex = ESCAPES[0].indexOf(this.character);
            if (escapeIndex != -1) {
                this.character = ESCAPES[1].charAt(escapeIndex);
            }
            else if (this.character == '\n') {
                this.columnNumber = -1;
                read();
            }
            else if (this.character == 'u') {
                readUnicode();
            }
        }

        private void readUnicode() throws IOException {
            this.character = 0;
            for (int i = 0; i < 4; i++) {
                int digit = this.reader.read();
                if (digit >= '0' && digit <= '9') {
                    this.character = (this.character << 4) + digit - '0';
                }
                else if (digit >= 'a' && digit <= 'f') {
                    this.character = (this.character << 4) + digit - 'a' + 10;
                }
                else if (digit >= 'A' && digit <= 'F') {
                    this.character = (this.character << 4) + digit - 'A' + 10;
                }
                else {
                    throw new IllegalStateException("Malformed \\uxxxx encoding.");
                }
            }
        }

        boolean isWhiteSpace() {
            return !this.escaped && (this.character == ' ' || this.character == '\t' || this.character == '\f');
        }

        boolean isEndOfFile() {
            return this.character == -1;
        }

        boolean isEndOfLine() {
            return this.character == -1 || (!this.escaped && this.character == '\n');
        }

        boolean isListDelimiter() {
            return !this.escaped && this.character == ',';
        }

        boolean isPropertyDelimiter() {
            return !this.escaped && (this.character == '=' || this.character == ':');
        }

        char getCharacter() {
            return (char) this.character;
        }

        TextResourceOrigin.Location getLocation() {
            return new TextResourceOrigin.Location(this.reader.getLineNumber(), this.columnNumber);
        }

        boolean isSameLastLineCommentPrefix() {
            return this.lastLineCommentPrefixCharacter == this.character;
        }

        boolean isCommentPrefixCharacter() {
            return this.character == '#' || this.character == '!';
        }

        boolean isHyphenCharacter() {
            return this.character == '-';
        }

    }

    /**
     * A single document within the properties file.
     */
    static class Document {

        private final Map<String, OriginTrackedValue> values = new LinkedHashMap<>();

        void put(String key, OriginTrackedValue value) {
            if (!key.isEmpty()) {
                this.values.put(key, value);
            }
        }

        boolean isEmpty() {
            return this.values.isEmpty();
        }

        Map<String, OriginTrackedValue> asMap() {
            return this.values;
        }

    }

}

 

在resources目錄下創建META-INF文件夾，然後創建spring.factories文件

在spring.factories文件裏添加如下內容：

org.springframework.boot.env.PropertySourceLoader=com.imddysc.configserver.encode.CustomizedPropertiesPropertySourceLoader

 

附：

就是這位大哥的方法：https://www.cnblogs.com/dada-hua/p/16052898.html

 

運行結果：