Spring Cloud Gateway 內(nèi)存溢出的解決方案
由于網(wǎng)關(guān)存在 RequestBody 丟失的情況,顧采用了網(wǎng)上的通用解決方案,使用如下方式解決:
@Beanpublic RouteLocator tpauditRoutes(RouteLocatorBuilder builder) { return builder.routes().route('gateway-post', r -> r.order(1) .method(HttpMethod.POST) .and() .readBody(String.class, requestBody -> {return true;}) # 重點(diǎn)在這 .and() .path('/gateway/**') .filters(f -> {f.stripPrefix(1);return f;}) .uri('lb://APP-API')).build();}
測(cè)試環(huán)境,Spring Cloud Gateway 網(wǎng)關(guān)功能編寫完成。開(kāi)始進(jìn)行測(cè)試環(huán)境壓測(cè)。
正常采用梯度壓測(cè)方式,最高用戶峰值設(shè)置為400并發(fā)。經(jīng)歷兩輪時(shí)長(zhǎng)10分鐘左右壓測(cè),沒(méi)有異常情況出現(xiàn)。
中午吃飯時(shí)間,設(shè)置了1個(gè)小時(shí)的時(shí)間進(jìn)行測(cè)試。
回來(lái)的時(shí)候系統(tǒng)報(bào)出如下異常2019-08-12 15:06:07,296 1092208 [reactor-http-server-epoll-12] WARN io.netty.channel.AbstractChannelHandlerContext.warn:146 - An exception ’{}’ [enable DEBUG level for full stacktrace] was thrown by a user handler’s exceptionCaught() method while handling the following exception:io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 byte(s) of direct memory (used: 503316487, max: 504889344) at io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:640) at io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:594) at io.netty.buffer.PoolArena$DirectArena.allocateDirect(PoolArena.java:764) at io.netty.buffer.PoolArena$DirectArena.newChunk(PoolArena.java:740) at io.netty.buffer.PoolArena.allocateNormal(PoolArena.java:244) at io.netty.buffer.PoolArena.allocate(PoolArena.java:214) at io.netty.buffer.PoolArena.allocate(PoolArena.java:146) at io.netty.buffer.PooledByteBufAllocator.newDirectBuffer(PooledByteBufAllocator.java:324) at io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:185) at io.netty.buffer.AbstractByteBufAllocator.directBuffer(AbstractByteBufAllocator.java:176) at io.netty.buffer.AbstractByteBufAllocator.ioBuffer(AbstractByteBufAllocator.java:137) at io.netty.channel.DefaultMaxMessagesRecvByteBufAllocator$MaxMessageHandle.allocate(DefaultMaxMessagesRecvByteBufAllocator.java:114) at io.netty.channel.epoll.EpollRecvByteAllocatorHandle.allocate(EpollRecvByteAllocatorHandle.java:72) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:793) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe$1.run(AbstractEpollChannel.java:382) at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163) at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:404) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:315) at io.
當(dāng)時(shí)一臉懵逼,馬上開(kāi)始監(jiān)控 Jvm 堆棧,減少jvm的內(nèi)存空間,提升并發(fā)數(shù)以后,重啟項(xiàng)目重新壓測(cè),
項(xiàng)目啟動(dòng)參數(shù)如下:java -jar -Xmx1024M /opt/deploy/gateway-appapi/cloud-employ-gateway-0.0.5-SNAPSHOT.jar↓↓↓↓修改為↓↓↓↓java -jar -Xmx512M /opt/deploy/gateway-appapi/cloud-employ-gateway-0.0.5-SNAPSHOT.jar
縮減了一半內(nèi)存啟動(dòng),等待問(wèn)題復(fù)現(xiàn)。等待3分鐘問(wèn)題再次復(fù)現(xiàn),但是同時(shí)Jvm卻的進(jìn)行了Full GC。
EC EUOC OU MC MU CCSC CCSU YGC YGCT FGC FGCT 275456.0 100103.0 484864.0 50280.2 67672.0 64001.3 9088.0 8463.2 501 11.945 3 0.262 275968.0 25072.3 484864.0 47329.3 67672.0 63959.4 9088.0 8448.8 502 11.970 4 0.429
沒(méi)錯(cuò),在出現(xiàn)問(wèn)題的時(shí)候,系統(tǒng)出現(xiàn)了Full Gc,但是OU并沒(méi)有達(dá)到觸發(fā)的原因。
結(jié)合日志中的 direct memory,想到了Jvm 中的堆外內(nèi)存。
使用 -XX:MaxDirectMemorySize 可以進(jìn)行設(shè)置 Jvm 堆外內(nèi)存大小,當(dāng) Direct ByteBuffer 分配的堆外內(nèi)存到達(dá)指定大小后,即觸發(fā)Full GC。
該值是有上限的,默認(rèn)是64M,最大為 sun.misc.VM.maxDirectMemory()。
結(jié)合所有情況,表明堆外內(nèi)存使用存在內(nèi)存溢出的情況。
報(bào)錯(cuò)內(nèi)容為Netty框架,新增以下配置,開(kāi)啟Netty錯(cuò)誤日志打印:-Dio.netty.leakDetection.targetRecords=40 #設(shè)置Records 上限-Dio.netty.leakDetection.level=advanced #設(shè)置日志級(jí)別項(xiàng)目啟動(dòng),沒(méi)任何問(wèn)題,開(kāi)啟壓測(cè)后服務(wù)報(bào)出如下異常:
2019-08-13 14:59:01,656 18047 [reactor-http-nio-7] ERROR io.netty.util.ResourceLeakDetector.reportTracedLeak:317 - LEAK: ByteBuf.release() was not called before it’s garbage-collected. See http://netty.io/wiki/reference-counted-objects.html for more information.Recent access records: #1:org.springframework.core.io.buffer.NettyDataBuffer.release(NettyDataBuffer.java:301)org.springframework.core.io.buffer.DataBufferUtils.release(DataBufferUtils.java:420)org.springframework.core.codec.StringDecoder.decodeDataBuffer(StringDecoder.java:208)org.springframework.core.codec.StringDecoder.decodeDataBuffer(StringDecoder.java:59)org.springframework.core.codec.AbstractDataBufferDecoder.lambda$decodeToMono$1(AbstractDataBufferDecoder.java:68)reactor.core.publisher.FluxMapFuseable$MapFuseableSubscriber.onNext(FluxMapFuseable.java:107)reactor.core.publisher.FluxContextStart$ContextStartSubscriber.onNext(FluxContextStart.java:103)reactor.core.publisher.FluxMapFuseable$MapFuseableConditionalSubscriber.onNext(FluxMapFuseable.java:287)reactor.core.publisher.FluxFilterFuseable$FilterFuseableConditionalSubscriber.onNext(FluxFilterFuseable.java:331)reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1505)reactor.core.publisher.MonoCollectList$MonoBufferAllSubscriber.onComplete(MonoCollectList.java:123)reactor.core.publisher.FluxJust$WeakScalarSubscription.request(FluxJust.java:101)reactor.core.publisher.MonoCollectList$MonoBufferAllSubscriber.onSubscribe(MonoCollectList.java:90)reactor.core.publisher.FluxJust.subscribe(FluxJust.java:70)reactor.core.publisher.FluxDefer.subscribe(FluxDefer.java:54)reactor.core.publisher.MonoCollectList.subscribe(MonoCollectList.java:59)reactor.core.publisher.MonoFilterFuseable.subscribe(MonoFilterFuseable.java:44)reactor.core.publisher.MonoMapFuseable.subscribe(MonoMapFuseable.java:56)reactor.core.publisher.MonoSubscriberContext.subscribe(MonoSubscriberContext.java:47)reactor.core.publisher.MonoMapFuseable.subscribe(MonoMapFuseable.java:59)reactor.core.publisher.MonoOnErrorResume.subscribe(MonoOnErrorResume.java:44)reactor.core.publisher.MonoOnErrorResume.subscribe(MonoOnErrorResume.java:44)reactor.core.publisher.MonoPeek.subscribe(MonoPeek.java:71)reactor.core.publisher.MonoMap.subscribe(MonoMap.java:55)reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:150)reactor.core.publisher.FluxContextStart$ContextStartSubscriber.onNext(FluxContextStart.java:103)reactor.core.publisher.FluxMapFuseable$MapFuseableConditionalSubscriber.onNext(FluxMapFuseable.java:287)reactor.core.publisher.FluxFilterFuseable$FilterFuseableConditionalSubscriber.onNext(FluxFilterFuseable.java:331)reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1505)reactor.core.publisher.MonoCollectList$MonoBufferAllSubscriber.onComplete(MonoCollectList.java:123)reactor.core.publisher.FluxMap$MapSubscriber.onComplete(FluxMap.java:136)reactor.core.publisher.FluxPeek$PeekSubscriber.onComplete(FluxPeek.java:252)reactor.core.publisher.FluxMap$MapSubscriber.onComplete(FluxMap.java:136)reactor.netty.channel.FluxReceive.terminateReceiver(FluxReceive.java:372)reactor.netty.channel.FluxReceive.drainReceiver(FluxReceive.java:196)reactor.netty.channel.FluxReceive.onInboundComplete(FluxReceive.java:337)reactor.netty.channel.ChannelOperations.onInboundComplete(ChannelOperations.java:333)reactor.netty.http.server.HttpServerOperations.onInboundNext(HttpServerOperations.java:453)reactor.netty.channel.ChannelOperationsHandler.channelRead(ChannelOperationsHandler.java:141)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:359)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:345)io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:337)reactor.netty.http.server.HttpTrafficHandler.channelRead(HttpTrafficHandler.java:191)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:359)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:345)io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:337)io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:438)io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323)io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297)io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:253)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:359)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:345)io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:337)io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1408)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:359)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:345)io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:930)io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:677)io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:612)io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:529)io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:491)io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:905)java.lang.Thread.run(Unknown Source)#2:io.netty.buffer.AdvancedLeakAwareByteBuf.nioBuffer(AdvancedLeakAwareByteBuf.java:712)org.springframework.core.io.buffer.NettyDataBuffer.asByteBuffer(NettyDataBuffer.java:266)org.springframework.core.codec.StringDecoder.decodeDataBuffer(StringDecoder.java:207)org.springframework.core.codec.StringDecoder.decodeDataBuffer(StringDecoder.java:59)org.springframework.core.codec.AbstractDataBufferDecoder.lambda$decodeToMono$1(AbstractDataBufferDecoder.java:68)reactor.core.publisher.FluxMapFuseable$MapFuseableSubscriber.onNext(FluxMapFuseable.java:107)reactor.core.publisher.FluxContextStart$ContextStartSubscriber.onNext(FluxContextStart.java:103)reactor.core.publisher.FluxMapFuseable$MapFuseableConditionalSubscriber.onNext(FluxMapFuseable.java:287)reactor.core.publisher.FluxFilterFuseable$FilterFuseableConditionalSubscriber.onNext(FluxFilterFuseable.java:331)reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1505)reactor.core.publisher.MonoCollectList$MonoBufferAllSubscriber.onComplete(MonoCollectList.java:123)reactor.core.publisher.FluxJust$WeakScalarSubscription.request(FluxJust.java:101)reactor.core.publisher.MonoCollectList$MonoBufferAllSubscriber.onSubscribe(MonoCollectList.java:90)reactor.core.publisher.FluxJust.subscribe(FluxJust.java:70)reactor.core.publisher.FluxDefer.subscribe(FluxDefer.java:54)reactor.core.publisher.MonoCollectList.subscribe(MonoCollectList.java:59)reactor.core.publisher.MonoFilterFuseable.subscribe(MonoFilterFuseable.java:44)reactor.core.publisher.MonoMapFuseable.subscribe(MonoMapFuseable.java:56)reactor.core.publisher.MonoSubscriberContext.subscribe(MonoSubscriberContext.java:47)reactor.core.publisher.MonoMapFuseable.subscribe(MonoMapFuseable.java:59)reactor.core.publisher.MonoOnErrorResume.subscribe(MonoOnErrorResume.java:44)reactor.core.publisher.MonoOnErrorResume.subscribe(MonoOnErrorResume.java:44)reactor.core.publisher.MonoPeek.subscribe(MonoPeek.java:71)reactor.core.publisher.MonoMap.subscribe(MonoMap.java:55)reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:150)reactor.core.publisher.FluxContextStart$ContextStartSubscriber.onNext(FluxContextStart.java:103)reactor.core.publisher.FluxMapFuseable$MapFuseableConditionalSubscriber.onNext(FluxMapFuseable.java:287)reactor.core.publisher.FluxFilterFuseable$FilterFuseableConditionalSubscriber.onNext(FluxFilterFuseable.java:331)reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1505)reactor.core.publisher.MonoCollectList$MonoBufferAllSubscriber.onComplete(MonoCollectList.java:123)reactor.core.publisher.FluxMap$MapSubscriber.onComplete(FluxMap.java:136)reactor.core.publisher.FluxPeek$PeekSubscriber.onComplete(FluxPeek.java:252)reactor.core.publisher.FluxMap$MapSubscriber.onComplete(FluxMap.java:136)reactor.netty.channel.FluxReceive.terminateReceiver(FluxReceive.java:372)reactor.netty.channel.FluxReceive.drainReceiver(FluxReceive.java:196)reactor.netty.channel.FluxReceive.onInboundComplete(FluxReceive.java:337)reactor.netty.channel.ChannelOperations.onInboundComplete(ChannelOperations.java:333)reactor.netty.http.server.HttpServerOperations.onInboundNext(HttpServerOperations.java:453)reactor.netty.channel.ChannelOperationsHandler.channelRead(ChannelOperationsHandler.java:141)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:359)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:345)io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:337)reactor.netty.http.server.HttpTrafficHandler.channelRead(HttpTrafficHandler.java:191)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:359)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:345)io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:337)io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:438)io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323)io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297)io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:253)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:359)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:345)io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:337)io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1408)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:359)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:345)io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:930)io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:677)io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:612)io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:529)io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:491)io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:905)java.lang.Thread.run(Unknown Source)#3:io.netty.buffer.AdvancedLeakAwareByteBuf.slice(AdvancedLeakAwareByteBuf.java:82)org.springframework.core.io.buffer.NettyDataBuffer.slice(NettyDataBuffer.java:260)org.springframework.core.io.buffer.NettyDataBuffer.slice(NettyDataBuffer.java:42)org.springframework.cloud.gateway.handler.predicate.ReadBodyPredicateFactory.lambda$null$0(ReadBodyPredicateFactory.java:102)reactor.core.publisher.FluxDefer.subscribe(FluxDefer.java:46)reactor.core.publisher.MonoCollectList.subscribe(MonoCollectList.java:59)reactor.core.publisher.MonoFilterFuseable.subscribe(MonoFilterFuseable.java:44)reactor.core.publisher.MonoMapFuseable.subscribe(MonoMapFuseable.java:56)reactor.core.publisher.MonoSubscriberContext.subscribe(MonoSubscriberContext.java:47)reactor.core.publisher.MonoMapFuseable.subscribe(MonoMapFuseable.java:59)reactor.core.publisher.MonoOnErrorResume.subscribe(MonoOnErrorResume.java:44)reactor.core.publisher.MonoOnErrorResume.subscribe(MonoOnErrorResume.java:44)reactor.core.publisher.MonoPeek.subscribe(MonoPeek.java:71)reactor.core.publisher.MonoMap.subscribe(MonoMap.java:55)reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:150)reactor.core.publisher.FluxContextStart$ContextStartSubscriber.onNext(FluxContextStart.java:103)reactor.core.publisher.FluxMapFuseable$MapFuseableConditionalSubscriber.onNext(FluxMapFuseable.java:287)reactor.core.publisher.FluxFilterFuseable$FilterFuseableConditionalSubscriber.onNext(FluxFilterFuseable.java:331)reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1505)reactor.core.publisher.MonoCollectList$MonoBufferAllSubscriber.onComplete(MonoCollectList.java:123)reactor.core.publisher.FluxMap$MapSubscriber.onComplete(FluxMap.java:136)reactor.core.publisher.FluxPeek$PeekSubscriber.onComplete(FluxPeek.java:252)reactor.core.publisher.FluxMap$MapSubscriber.onComplete(FluxMap.java:136)reactor.netty.channel.FluxReceive.terminateReceiver(FluxReceive.java:372)reactor.netty.channel.FluxReceive.drainReceiver(FluxReceive.java:196)reactor.netty.channel.FluxReceive.onInboundComplete(FluxReceive.java:337)reactor.netty.channel.ChannelOperations.onInboundComplete(ChannelOperations.java:333)reactor.netty.http.server.HttpServerOperations.onInboundNext(HttpServerOperations.java:453)reactor.netty.channel.ChannelOperationsHandler.channelRead(ChannelOperationsHandler.java:141)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:359)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:345)io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:337)reactor.netty.http.server.HttpTrafficHandler.channelRead(HttpTrafficHandler.java:191)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:359)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:345)io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:337)io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:438)io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323)io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297)io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:253)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:359)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:345)io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:337)io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1408)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:359)io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:345)io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:930)io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:677)io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:612)io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:529)io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:491)io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:905)java.lang.Thread.run(Unknown Source)
在 #3 中,我發(fā)現(xiàn)了一個(gè)眼熟的類,ReadBodyPredicateFactory.java ,還記得最開(kāi)始的時(shí)候使用 readbody 配置么?
這里就是進(jìn)行 cachedRequestBodyObject 的寫入類,
追蹤一下Readbody源碼/** * This predicate is BETA and may be subject to change in a future release. A * predicate that checks the contents of the request body * @param inClass the class to parse the body to * @param predicate a predicate to check the contents of the body * @param <T> the type the body is parsed to * @return a {@link BooleanSpec} to be used to add logical operators */ public <T> BooleanSpec readBody(Class<T> inClass, Predicate<T> predicate) { return asyncPredicate(getBean(ReadBodyPredicateFactory.class) .applyAsync(c -> c.setPredicate(inClass, predicate))); }
異步調(diào)用的 ReadBodyPredicateFactory.applyAsync() 和 錯(cuò)誤日志中的
org.springframework.cloud.gateway.handler.predicate.ReadBodyPredicateFactory.lambda$null$0(ReadBodyPredicateFactory.java:102)
指向方法一致。查看源碼102行:
Flux<DataBuffer> cachedFlux = Flux.defer(() -> Flux.just(dataBuffer.slice(0, dataBuffer.readableByteCount())));
此處 Spring Cloud Gateway 通過(guò) dataBuffer.slice 切割出了新的 dataBuffer,但是通過(guò) Netty 的內(nèi)存檢測(cè)工具判斷,此處的 dataBuffer 并沒(méi)有被回收。
錯(cuò)誤如下,日志很多容易被忽視。ERROR io.netty.util.ResourceLeakDetector.reportTracedLeak:317 - LEAK: ByteBuf.release() was not called before it’s garbage-collected. See http://netty.io/wiki/reference-counted-objects.html for more information.
找到問(wèn)題那就要解決才行,嘗試修改源碼@Override@SuppressWarnings('unchecked')public AsyncPredicate<ServerWebExchange> applyAsync(Config config) { return exchange -> {Class inClass = config.getInClass();Object cachedBody = exchange.getAttribute(CACHE_REQUEST_BODY_OBJECT_KEY);Mono<?> modifiedBody;// We can only read the body from the request once, once that// happens if we// try to read the body again an exception will be thrown. The below// if/else// caches the body object as a request attribute in the// ServerWebExchange// so if this filter is run more than once (due to more than one// route// using it) we do not try to read the request body multiple timesif (cachedBody != null) { try {boolean test = config.predicate.test(cachedBody);exchange.getAttributes().put(TEST_ATTRIBUTE, test);return Mono.just(test); } catch (ClassCastException e) {if (LOGGER.isDebugEnabled()) { LOGGER.debug('Predicate test failed because class in predicate ' + 'does not match the cached body object', e);} } return Mono.just(false);} else { // Join all the DataBuffers so we have a single DataBuffer for // the body return DataBufferUtils.join(exchange.getRequest().getBody()).flatMap(dataBuffer -> {// Update the retain counts so we can read the body twice,// once to parse into an object// that we can test the predicate against and a second time// when the HTTP client sends// the request downstream// Note: if we end up reading the body twice we will run// into// a problem, but as of right// now there is no good use case for doing thisDataBufferUtils.retain(dataBuffer);// Make a slice for each read so each read has its own// read/write indexesFlux<DataBuffer> cachedFlux = Flux.defer(() -> Flux.just(dataBuffer.slice(0, dataBuffer.readableByteCount())));ServerHttpRequest mutatedRequest = new ServerHttpRequestDecorator(exchange.getRequest()) { @Override public Flux<DataBuffer> getBody() {return cachedFlux; }};# 新增如下代碼DataBufferUtils.release(dataBuffer);return ServerRequest.create(exchange.mutate().request(mutatedRequest).build(), messageReaders).bodyToMono(inClass).doOnNext(objectValue -> { exchange.getAttributes().put(CACHE_REQUEST_BODY_OBJECT_KEY, objectValue); exchange.getAttributes().put(CACHED_REQUEST_BODY_KEY, cachedFlux);}).map(objectValue -> config.predicate.test(objectValue)); });} };}
Spring Cloud Gateway 在配置的架構(gòu)中,版本為2.1.1,修改以上代碼后,啟動(dòng)項(xiàng)目測(cè)試,問(wèn)題沒(méi)有復(fù)現(xiàn),正常運(yùn)行。
同樣這個(gè)問(wèn)題,也可以選擇升級(jí) Spring Cloud Gateway 版本,在官方2.1.2版本中,此處代碼已被重構(gòu),升級(jí)后測(cè)試也完全正常。
以上為個(gè)人經(jīng)驗(yàn),希望能給大家一個(gè)參考,也希望大家多多支持好吧啦網(wǎng)。
相關(guān)文章:
1. vue實(shí)現(xiàn)web在線聊天功能2. IntelliJ IDEA設(shè)置自動(dòng)提示功能快捷鍵的方法3. Java Bean與Map之間相互轉(zhuǎn)化的實(shí)現(xiàn)方法4. SpringBoot+TestNG單元測(cè)試的實(shí)現(xiàn)5. Springboot 全局日期格式化處理的實(shí)現(xiàn)6. Java使用Tesseract-Ocr識(shí)別數(shù)字7. Python使用urlretrieve實(shí)現(xiàn)直接遠(yuǎn)程下載圖片的示例代碼8. Django使用HTTP協(xié)議向服務(wù)器傳參方式小結(jié)9. JAMon(Java Application Monitor)備忘記10. 完美解決vue 中多個(gè)echarts圖表自適應(yīng)的問(wèn)題
