我正在做一个项目,将打字机写的战争日记笔记从 PDF 扫描转换为文本。我可以成功(可能 90% 使用原始非调整大小的文件)提取我首先裁剪的主要文本。
Reprex 数据:您可以从图像开始尝试,或者使用我在下面提供的文本。
我的挑战是保持文本的“每日”结构,它有 7 个段落或部分,每天一个,并且用“\n”或“\n\n”分割并不完全正确。
我在项目中使用了 pdftools/stringr/tesseract/magick 的组合:
library(tesseract)
library(dplyr)
library(stringr)
library(pdftools)
library(readr)
library(magick)
使用:
image <- image_read("./test-data/page_1.png") #change to your path
text -> image %>%
image_crop(geometry_area(width = 1220, height = 900,
y_off = 260, x_off = 355)) %>%
image_resize("2000x") %>%
image_convert(type = 'Grayscale') %>%
image_trim(fuzz = 40) %>%
image_write(format = 'png', density = '300x300') %>%
tesseract::ocr()
给出一个字符串:
[1] "Weather clear all day. A smaii arms inspection hela at i400 hrs. A recce party went\nlout consisting of Coy Comds and Lt Col Nicklin, I.0. and Asst Adjt. An Orders group\nheld in the evening. Pay parade for HQ and Bn HQ was at 1900 hrs. A movie was shown\nlfor B Coy personnel by our YMCA Supervisor. o\nWeather clear and cold all day. Personnel packed equipment early in the morning and |-~\nwere ready to move at 0830 hrs. Unit embussed at 0900 hrs and moved to Rochefort, MR\n2076, Sheet 105, 1/25000, arriving at 1390 hrs. Coys were in position at 1600 hrs. |,.\nPW brought in by A Coy at 1900 hrs. PW was a deserter from 304 Regt 2 Pz division. | .\n© other activity during the day. Patrols were sent out during the night by all coys,.\nCold all day. Very quiet all morning. A Coy moved forward. Coy HQ set up at Chatea\nVieux de Rochefort. Slight opposition met by A Coy on advance. Opposition met at\n\\Croic St Jean. A Coy was in position at 1700 hrs. Advance started at 1500 hrs. OP\nset up at 1900 hrs at MR 207753. Patrols sent out by all Coys. 7\nHeather wet all day. Snowed most of the day. 1 Pl from C Coy guarding bridge MR\n204767. A Coy sent a fighting patrol to clear Powder Mill woods MR 2074. Recce\natrols sent out byall coys. 7\neather fair all day. No enemy was seen during the day. A Coy sent out patrols during\ntthe day and night but no opposition memt. B Coy moved forward to MR 195771. Orders\nGroup held at 2000 hrs and orders were given to have all personnel ready to move to\nnew location by 1200 hrs on the 6 of Jan 1945. YMCA was to show a movie in the evenp\ning but the CO cancelled it. Two Polish deserters from the German army walked into\nCoy lines. 4\neather clear all day. CO, Coy Comds, Sig Officer and Vickers Officer left to recce\new location at 0830 hrs. Unit started to move to new location at 1200 hrs. Unit a\nrived at AYE MR 2683, Sheet 91, 1\" to mile at 1500 hrs. Personnel were shown to\ntheir areas and billets. | «\neather clear all day. Observation Post set up by the Intelligence Sec at MR 253813.) ,\nQuiet all day. No enemy activity during the day.\neather overcast and snowing. Intelligence Section set up another OP at MR 268814,\no enemy activity during thle day. At 2300 hrs orders were received that all personnel\nere to be ready to move to new area on the morning of the 9th Jan, 1945. ;\nWeather clear and cold. Bn started to move at 0830 hrs. Bn reached Champlon ‘\nFamenine, MR qibe at 1230 hrs. Bn relieved the HLI. Coys immediately took up\npositions or all around defence.\n"
使用stringr
,这可以通过句子结尾大致拆分:
stringr::str_split(text, pattern = "\n")
[[1]]
[1] "Weather clear all day. A smaii arms inspection hela at i400 hrs. A recce party went"
[2] "lout consisting of Coy Comds and Lt Col Nicklin, I.0. and Asst Adjt. An Orders group"
[3] "held in the evening. Pay parade for HQ and Bn HQ was at 1900 hrs. A movie was shown"
[4] "lfor B Coy personnel by our YMCA Supervisor. o"
[5] "Weather clear and cold all day. Personnel packed equipment early in the morning and |-~"
[6] "were ready to move at 0830 hrs. Unit embussed at 0900 hrs and moved to Rochefort, MR"
[7] "2076, Sheet 105, 1/25000, arriving at 1390 hrs. Coys were in position at 1600 hrs. |,."
[8] "PW brought in by A Coy at 1900 hrs. PW was a deserter from 304 Regt 2 Pz division. | ."
[9] "© other activity during the day. Patrols were sent out during the night by all coys,."
[10] "Cold all day. Very quiet all morning. A Coy moved forward. Coy HQ set up at Chatea"
[11] "Vieux de Rochefort. Slight opposition met by A Coy on advance. Opposition met at"
[12] "\\Croic St Jean. A Coy was in position at 1700 hrs. Advance started at 1500 hrs. OP"
[13] "set up at 1900 hrs at MR 207753. Patrols sent out by all Coys. 7"
[14] "Heather wet all day. Snowed most of the day. 1 Pl from C Coy guarding bridge MR"
[15] "204767. A Coy sent a fighting patrol to clear Powder Mill woods MR 2074. Recce"
[16] "atrols sent out byall coys. 7"
[17] "eather fair all day. No enemy was seen during the day. A Coy sent out patrols during"
[18] "tthe day and night but no opposition memt. B Coy moved forward to MR 195771. Orders"
[19] "Group held at 2000 hrs and orders were given to have all personnel ready to move to"
[20] "new location by 1200 hrs on the 6 of Jan 1945. YMCA was to show a movie in the evenp"
[21] "ing but the CO cancelled it. Two Polish deserters from the German army walked into"
[22] "Coy lines. 4"
[23] "eather clear all day. CO, Coy Comds, Sig Officer and Vickers Officer left to recce"
[24] "ew location at 0830 hrs. Unit started to move to new location at 1200 hrs. Unit a"
[25] "rived at AYE MR 2683, Sheet 91, 1\" to mile at 1500 hrs. Personnel were shown to"
[26] "their areas and billets. | «"
[27] "eather clear all day. Observation Post set up by the Intelligence Sec at MR 253813.) ,"
[28] "Quiet all day. No enemy activity during the day."
[29] "eather overcast and snowing. Intelligence Section set up another OP at MR 268814,"
[30] "o enemy activity during thle day. At 2300 hrs orders were received that all personnel"
[31] "ere to be ready to move to new area on the morning of the 9th Jan, 1945. ;"
[32] "Weather clear and cold. Bn started to move at 0830 hrs. Bn reached Champlon ‘"
[33] "Famenine, MR qibe at 1230 hrs. Bn relieved the HLI. Coys immediately took up"
[34] "positions or all around defence."
[35] ""
有什么想法可以改进它以在每个结尾找到特定的模式吗?
我可能只是导出拆分的原样并从此处以 word 手动复制/粘贴。
非常感谢!!