Java 中java.io.IOException: Broken pipe
認識broken pipe
pipe是管道的意思,管道里面是數據流,通常是從文件或網絡套接字讀取的數據。
當該管道從另一端突然關閉時,會發生數據突然中斷,即是broken。
對於文件File來說,這可能是文件安裝在已斷開連接的光盤或遠程網絡上。
對於socket來說,可能是網絡被拔出或另一端的進程崩潰。
在Java中,沒有具體的BrokenPipeException。
將此類錯誤包含在另一個異常,例如java.io.IOException:Broken pipe
解決問題
其實當該異常產生的時候,對於服務端來說,並沒有多少影響。因爲可能是某個客戶端突然中止了進程導致了該錯誤。但是爲了程序能夠美觀、優雅,還是要在合適的地方捕獲該異常,並處理一下。
還有一種可能性就是程序裏面有代碼執行時間過長,用戶等待時間過久,纔會強行中止進程。
那麼這種情況下就需要去分析log中報異常的地方是經常發生在什麼地方,合理優化該段代碼,提升代碼的運行速度,才能從根本上避免此類問題的再次發生。
可能原因:
1、客戶端請求服務器數據,服務器突然掛了;
2、客戶端請求服務端數據,服務端正常返回,凡是客戶端由於超時等原因斷開。
原因分析:
做了壓力測試,發現遇到的情況屬於第二種,由於去數據庫取數據的時候,30秒裏無法正常獲取有效的數據庫連接,或者查詢時間長,導致OSB過來的請求超時,也就是客戶端超時了,服務端還試圖返回數據,結果導致如題異常。
解決方法:
1、增大數據庫連接池數量;
2、延長客戶端超時時間。
java.io.IOException: Broken pipe 線上問題記錄
今天在上線前staging環境驗證時遇到這樣一個問題java.io.IOException: Broken pipe,操作服務剛起來之後,測試人員第一次進行更配[post]操作,結果操作失敗,但是第二次就好了,
我們是springboot+angularJs前後端分離,然後服務使用k8s在容器中部署,原始的異常棧信息是這樣,
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
|
2019 - 09 -26T02: 42 :09Z [http-nio- 8080 -exec- 9 ] WARN [org.springframework.web.servlet.mvc.method.annotation.ExceptionHandlerExceptionResolver: 411 ] - Failed to invoke @ExceptionHandler method: public org.springframework.http.ResponseEntity<com.inspur.common.exception.ErrorResponse> com.inspur.common.exception.CommonControllerAdvice.exceptionHandler(javax.servlet.http.HttpServletRequest,java.lang.Exception) org.apache.catalina.connector.ClientAbortException: java.io.IOException: Broken pipe at org.apache.catalina.connector.OutputBuffer.doFlush(OutputBuffer.java: 321 ) at org.apache.catalina.connector.OutputBuffer.flush(OutputBuffer.java: 284 ) at org.apache.catalina.connector.CoyoteOutputStream.flush(CoyoteOutputStream.java: 118 ) at org.springframework.security.web.util.OnCommittedResponseWrapper$SaveContextServletOutputStream.flush(OnCommittedResponseWrapper.java: 514 ) at com.fasterxml.jackson.core.json.UTF8JsonGenerator.flush(UTF8JsonGenerator.java: 1100 ) at com.fasterxml.jackson.databind.ObjectWriter.writeValue(ObjectWriter.java: 915 ) at org.springframework.http.converter.json.AbstractJackson2HttpMessageConverter.writeInternal(AbstractJackson2HttpMessageConverter.java: 285 ) at org.springframework.http.converter.AbstractGenericHttpMessageConverter.write(AbstractGenericHttpMessageConverter.java: 102 ) at org.springframework.web.servlet.mvc.method.annotation.AbstractMessageConverterMethodProcessor.writeWithMessageConverters(AbstractMessageConverterMethodProcessor.java: 272 ) at org.springframework.web.servlet.mvc.method.annotation.HttpEntityMethodProcessor.handleReturnValue(HttpEntityMethodProcessor.java: 224 ) at org.springframework.web.method.support.HandlerMethodReturnValueHandlerComposite.handleReturnValue(HandlerMethodReturnValueHandlerComposite.java: 82 ) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java: 119 ) at org.springframework.web.servlet.mvc.method.annotation.ExceptionHandlerExceptionResolver.doResolveHandlerMethodException(ExceptionHandlerExceptionResolver.java: 400 ) at org.springframework.web.servlet.handler.AbstractHandlerMethodExceptionResolver.doResolveException(AbstractHandlerMethodExceptionResolver.java: 61 ) at org.springframework.web.servlet.handler.AbstractHandlerExceptionResolver.resolveException(AbstractHandlerExceptionResolver.java: 136 ) at org.springframework.web.servlet.handler.HandlerExceptionResolverComposite.resolveException(HandlerExceptionResolverComposite.java: 78 ) at org.springframework.web.servlet.DispatcherServlet.processHandlerException(DispatcherServlet.java: 1255 ) at org.springframework.web.servlet.DispatcherServlet.processDispatchResult(DispatcherServlet.java: 1062 ) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java: 1008 ) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java: 925 ) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java: 974 ) at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java: 866 ) at javax.servlet.http.HttpServlet.service(HttpServlet.java: 687 ) at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java: 851 ) at javax.servlet.http.HttpServlet.service(HttpServlet.java: 790 ) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 231 ) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java: 166 ) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java: 52 ) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 193 ) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java: 166 ) at com.inspur.common.filter.RepeatedlyReadFilter.doFilter(RepeatedlyReadFilter.java: 34 ) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 193 ) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java: 166 ) at com.inspur.eip.config.filter.KeyClockAuthFilter.doFilter(KeyClockAuthFilter.java: 53 ) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 193 ) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java: 166 ) at com.alibaba.druid.support.http.WebStatFilter.doFilter(WebStatFilter.java: 123 ) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 193 ) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java: 166 ) at com.alibaba.druid.support.http.WebStatFilter.doFilter(WebStatFilter.java: 123 ) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 193 ) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java: 166 ) at org.springframework.boot.actuate.web.trace.servlet.HttpTraceFilter.doFilterInternal(HttpTraceFilter.java: 90 ) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java: 107 ) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 193 ) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java: 166 ) at com.inspur.iam.adapter.filter.SecurityContextFilter.doFilter(SecurityContextFilter.java: 119 ) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 193 ) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java: 166 ) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java: 320 ) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java: 127 ) at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java: 91 ) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java: 334 ) at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java: 119 ) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java: 334 ) at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java: 137 ) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java: 334 ) at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java: 111 ) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java: 334 ) at org.keycloak.adapters.springsecurity.filter.KeycloakAuthenticatedActionsFilter.doFilter(KeycloakAuthenticatedActionsFilter.java: 74 ) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java: 334 ) at org.keycloak.adapters.springsecurity.filter.KeycloakSecurityContextRequestFilter.doFilter(KeycloakSecurityContextRequestFilter.java: 77 ) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java: 334 ) at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java: 170 ) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java: 334 ) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java: 63 ) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java: 334 ) at org.keycloak.adapters.springsecurity.filter.KeycloakAuthenticationProcessingFilter.successfulAuthentication(KeycloakAuthenticationProcessingFilter.java: 208 ) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java: 240 ) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java: 334 ) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java: 116 ) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java: 334 ) at org.keycloak.adapters.springsecurity.filter.KeycloakPreAuthActionsFilter.doFilter(KeycloakPreAuthActionsFilter.java: 84 ) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java: 334 ) at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java: 66 ) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java: 107 ) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java: 334 ) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java: 105 ) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java: 334 ) at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java: 56 ) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java: 107 ) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java: 334 ) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java: 215 ) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java: 178 ) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java: 357 ) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java: 270 ) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 193 ) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java: 166 ) at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java: 99 ) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java: 107 ) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 193 ) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java: 166 ) at org.springframework.web.filter.HttpPutFormContentFilter.doFilterInternal(HttpPutFormContentFilter.java: 109 ) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java: 107 ) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 193 ) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java: 166 ) at org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(HiddenHttpMethodFilter.java: 93 ) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java: 107 ) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 193 ) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java: 166 ) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.filterAndRecordMetrics(WebMvcMetricsFilter.java: 155 ) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.filterAndRecordMetrics(WebMvcMetricsFilter.java: 123 ) at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java: 108 ) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java: 107 ) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 193 ) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java: 166 ) at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java: 200 ) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java: 107 ) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java: 193 ) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java: 166 ) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java: 198 ) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java: 96 ) at org.keycloak.adapters.tomcat.AbstractAuthenticatedActionsValve.invoke(AbstractAuthenticatedActionsValve.java: 67 ) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java: 493 ) at org.keycloak.adapters.tomcat.AbstractKeycloakAuthenticatorValve.invoke(AbstractKeycloakAuthenticatorValve.java: 181 ) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java: 140 ) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java: 81 ) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java: 87 ) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java: 342 ) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java: 800 ) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java: 66 ) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java: 806 ) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java: 1498 ) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java: 49 ) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java: 1149 ) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java: 624 ) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java: 61 ) at java.lang.Thread.run(Thread.java: 748 ) Caused by: java.io.IOException: Broken pipe at sun.nio.ch.FileDispatcherImpl.write0(Native Method) at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java: 47 ) at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java: 93 ) at sun.nio.ch.IOUtil.write(IOUtil.java: 65 ) at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java: 471 ) at org.apache.tomcat.util.net.NioChannel.write(NioChannel.java: 134 ) at org.apache.tomcat.util.net.NioBlockingSelector.write(NioBlockingSelector.java: 101 ) at org.apache.tomcat.util.net.NioSelectorPool.write(NioSelectorPool.java: 157 ) at org.apache.tomcat.util.net.NioEndpoint$NioSocketWrapper.doWrite(NioEndpoint.java: 1306 ) at org.apache.tomcat.util.net.SocketWrapperBase.doWrite(SocketWrapperBase.java: 726 ) at org.apache.tomcat.util.net.SocketWrapperBase.flushBlocking(SocketWrapperBase.java: 679 ) at org.apache.tomcat.util.net.SocketWrapperBase.flush(SocketWrapperBase.java: 669 ) at org.apache.coyote.http11.Http11OutputBuffer$SocketOutputBuffer.flush(Http11OutputBuffer.java: 646 ) at org.apache.coyote.http11.filters.ChunkedOutputFilter.flush(ChunkedOutputFilter.java: 169 ) at org.apache.coyote.http11.Http11OutputBuffer.flush(Http11OutputBuffer.java: 252 ) at org.apache.coyote.http11.Http11Processor.flush(Http11Processor.java: 1561 ) at org.apache.coyote.AbstractProcessor.action(AbstractProcessor.java: 380 ) at org.apache.coyote.Response.action(Response.java: 173 ) at org.apache.catalina.connector.OutputBuffer.doFlush(OutputBuffer.java: 317 ) ... 127 more resolve exception |
之後的操作,就正常了,正常日誌如下:
google之後大概知道是什麼問題了
注:讀懂下面這句話,首先要熟悉TCP 四次揮手,不太熟悉 請右轉google
總結 Broken Pipe:
這個異常是客戶端讀取超時關閉了連接,這時候服務器端再向客戶端已經斷開的連接寫數據時就發生了broken pipe異常!
作爲一個後端工程師,一定要對日常的一些異常有一個積累總結,筆者就自己有在總結,一是總結整理之後,下次遇到同樣的問題自己不會很茫然不知所措,尤其是在上線是,其他同事都在等着你解決問題的時候,你吭吭唧唧那就不太好了,二是筆者之前在面試時也有經常被問到類似的問題,記憶尤新的就是被雲校的百度小哥問到connection by peer,之前博客也有介紹,作爲社招有經驗的工程師,更不能再以校招的面試作爲自己的標準了,要有自己的經驗積累,反正就是,幹,就完了
最後,附一張我的錯誤記事本截圖