我在多线程 java 程序中将大量记录插入数据库。
主线程创建所有线程并等待它们完成。
for(int i = 0; i < noOfThreads; i++) {
results.add(exec.submit(new InsertConnection()) );
Thread.sleep(1000);
}
for(Future<?> fs : results) {
try {
// This will wait till each thread is done
fs.get();
} catch (Exception e) {
logger.error(null, e);
}
}
每个线程都在数据库连接上运行,并将记录插入数据库。连接对象不在线程之间共享。像这样的东西
public class InsertConnection implements Runnable{
public InsertConnection() {
//create connection object
}
@Override
public void run() {
while(true)
//Fetch a betch
//Insert ina loop
}
}
}
就在程序结束之前,我看到一些线程 (2, 4 6) 无法插入,因为连接已关闭。我认为当 1 个线程完成它的工作时,套接字会以某种方式关闭。下面是例外
** BEGIN NESTED EXCEPTION **
com.mysql.jdbc.CommunicationsException
MESSAGE: Communications link failure due to underlying exception:
** BEGIN NESTED EXCEPTION **
java.net.SocketException
MESSAGE: Software caused connection abort: recv failed
STACKTRACE:
java.net.SocketException: Software caused connection abort: recv failed
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(Unknown Source)
at java.net.SocketInputStream.read(Unknown Source)
at com.mysql.jdbc.util.ReadAheadInputStream.fill(ReadAheadInputStream.java:113)
at com.mysql.jdbc.util.ReadAheadInputStream.readFromUnderlyingStreamIfNecessary(ReadAheadInputStream.java:160)
at com.mysql.jdbc.util.ReadAheadInputStream.read(ReadAheadInputStream.java:188)
at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:1994)
at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2411)
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:2916)
at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1631)
at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:1723)
at com.mysql.jdbc.Connection.execSQL(Connection.java:3283)
at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1332)
at com.mysql.jdbc.PreparedStatement.execute(PreparedStatement.java:882)
at com.mysql.jdbc.CallableStatement.execute(CallableStatement.java:759)
at mind.fire.connection.store.InsertConnection.execute(InsertConnection.java:81)
at mind.fire.connection.store.InsertConnection.run(InsertConnection.java:62)
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
** END NESTED EXCEPTION **