我有一个记录器，它有一个RotatingFileHandler. 我想将所有重定向Stdout到Stderr记录器。怎么做？
问问题
58251 次
9 回答
52
没有足够的代表发表评论，但我想添加对我有用的版本，以防其他人处于类似情况。
class LoggerWriter:
def __init__(self, level):
# self.level is really like using log.debug(message)
# at least in my case
self.level = level
def write(self, message):
# if statement reduces the amount of newlines that are
# printed to the logger
if message != '\n':
self.level(message)
def flush(self):
# create a flush method so things can be flushed when
# the system wants to. Not sure if simply 'printing'
# sys.stderr is the correct way to do it, but it seemed
# to work properly for me.
self.level(sys.stderr)
这看起来像：
log = logging.getLogger('foobar')
sys.stdout = LoggerWriter(log.debug)
sys.stderr = LoggerWriter(log.warning)
于 2015-07-28T22:45:12.120 回答
31
Python 3 的更新：
- 包括一个虚拟刷新函数，该函数可防止预期函数出现错误（Python 2 可以使用 just
linebuf=''）。 - 请注意，如果从解释器会话记录与从文件运行，您的输出（和日志级别）看起来会有所不同。从文件运行会产生预期的行为（以及下面的输出）。
- 我们仍然消除了其他解决方案没有的额外换行符。
class StreamToLogger(object):
"""
Fake file-like stream object that redirects writes to a logger instance.
"""
def __init__(self, logger, level):
self.logger = logger
self.level = level
self.linebuf = ''
def write(self, buf):
for line in buf.rstrip().splitlines():
self.logger.log(self.level, line.rstrip())
def flush(self):
pass
然后用类似的东西进行测试：
import StreamToLogger
import sys
import logging
logging.basicConfig(
level=logging.DEBUG,
format='%(asctime)s:%(levelname)s:%(name)s:%(message)s',
filename='out.log',
filemode='a'
)
log = logging.getLogger('foobar')
sys.stdout = StreamToLogger(log,logging.INFO)
sys.stderr = StreamToLogger(log,logging.ERROR)
print('Test to standard out')
raise Exception('Test to standard error')
请参阅下面的旧 Python 2.x 答案和示例输出：
所有先前的答案似乎都存在在不需要的地方添加额外的换行符的问题。最适合我的解决方案来自http://www.electricmonk.nl/log/2011/08/14/redirect-stdout-and-stderr-to-a-logger-in-python/，他在其中演示了如何将 stdout 和 stderr 都发送到记录器：
import logging
import sys
class StreamToLogger(object):
"""
Fake file-like stream object that redirects writes to a logger instance.
"""
def __init__(self, logger, log_level=logging.INFO):
self.logger = logger
self.log_level = log_level
self.linebuf = ''
def write(self, buf):
for line in buf.rstrip().splitlines():
self.logger.log(self.log_level, line.rstrip())
logging.basicConfig(
level=logging.DEBUG,
format='%(asctime)s:%(levelname)s:%(name)s:%(message)s',
filename="out.log",
filemode='a'
)
stdout_logger = logging.getLogger('STDOUT')
sl = StreamToLogger(stdout_logger, logging.INFO)
sys.stdout = sl
stderr_logger = logging.getLogger('STDERR')
sl = StreamToLogger(stderr_logger, logging.ERROR)
sys.stderr = sl
print "Test to standard out"
raise Exception('Test to standard error')
输出如下所示：
2011-08-14 14:46:20,573:INFO:STDOUT:Test to standard out
2011-08-14 14:46:20,573:ERROR:STDERR:Traceback (most recent call last):
2011-08-14 14:46:20,574:ERROR:STDERR: File "redirect.py", line 33, in
2011-08-14 14:46:20,574:ERROR:STDERR:raise Exception('Test to standard error')
2011-08-14 14:46:20,574:ERROR:STDERR:Exception
2011-08-14 14:46:20,574:ERROR:STDERR::
2011-08-14 14:46:20,574:ERROR:STDERR:Test to standard error
请注意，这self.linebuf = ''是处理刷新的地方，而不是实现刷新功能。
于 2016-08-29T22:10:59.367 回答
18
如果它是一个全 Python 系统（即没有 C 库直接写入 fds，正如 Ignacio Vazquez-Abrams 所问的那样），那么您可以使用这里建议的方法：
class LoggerWriter:
def __init__(self, logger, level):
self.logger = logger
self.level = level
def write(self, message):
if message != '\n':
self.logger.log(self.level, message)
然后设置和sys.stdout实例。sys.stderrLoggerWriter
于 2013-10-17T22:22:24.167 回答
15
您可以使用 redirect_stdout 上下文管理器：
import logging
from contextlib import redirect_stdout
logging.basicConfig(stream=sys.stdout, level=logging.DEBUG)
logging.write = lambda msg: logging.info(msg) if msg != '\n' else None
with redirect_stdout(logging):
print('Test')
或者像这样
import logging
from contextlib import redirect_stdout
logger = logging.getLogger('Meow')
logger.setLevel(logging.INFO)
formatter = logging.Formatter(
fmt='[{name}] {asctime} {levelname}: {message}',
datefmt='%m/%d/%Y %H:%M:%S',
style='{'
)
ch = logging.StreamHandler()
ch.setLevel(logging.INFO)
ch.setFormatter(formatter)
logger.addHandler(ch)
logger.write = lambda msg: logger.info(msg) if msg != '\n' else None
with redirect_stdout(logger):
print('Test')
于 2017-08-15T08:06:01.543 回答
11
作为对 Cameron Gagnon 响应的改进，我将LoggerWriter课程改进为：
class LoggerWriter(object):
def __init__(self, writer):
self._writer = writer
self._msg = ''
def write(self, message):
self._msg = self._msg + message
while '\n' in self._msg:
pos = self._msg.find('\n')
self._writer(self._msg[:pos])
self._msg = self._msg[pos+1:]
def flush(self):
if self._msg != '':
self._writer(self._msg)
self._msg = ''
现在不受控制的异常看起来更好：
2018-07-31 13:20:37,482 - ERROR - Traceback (most recent call last):
2018-07-31 13:20:37,483 - ERROR - File "mf32.py", line 317, in <module>
2018-07-31 13:20:37,485 - ERROR - main()
2018-07-31 13:20:37,486 - ERROR - File "mf32.py", line 289, in main
2018-07-31 13:20:37,488 - ERROR - int('')
2018-07-31 13:20:37,489 - ERROR - ValueError: invalid literal for int() with base 10: ''
于 2018-07-31T11:33:44.277 回答
9
输出重定向正确！
问题
logger.log而其他函数（.info/ .error/etc.）将每个调用输出为单独的行，即隐式添加（格式化和）换行符。
sys.stderr.write另一方面，只是将其文字输入写入流，包括部分行。例如：输出“ZeroDivisionError：除以零”实际上是 4(!) 次单独调用sys.stderr.write：
sys.stderr.write('ZeroDivisionError')
sys.stderr.write(': ')
sys.stderr.write('division by zero')
sys.stderr.write('\n')
因此，4 种最受好评的方法（1、2、3、4）会产生额外的换行符——只需将“1/0”放入您的程序中，您将获得以下信息：
2021-02-17 13:10:40,814 - ERROR - ZeroDivisionError
2021-02-17 13:10:40,814 - ERROR - :
2021-02-17 13:10:40,814 - ERROR - division by zero
解决方案
将中间写入存储在缓冲区中。我使用列表作为缓冲区而不是字符串的原因是为了避免Shlemiel thepainter's algorithm。TLDR：它是 O(n) 而不是可能的 O(n^2)
class LoggerWriter:
def __init__(self, logfct):
self.logfct = logfct
self.buf = []
def write(self, msg):
if msg.endswith('\n'):
self.buf.append(msg.removesuffix('\n'))
self.logfct(''.join(self.buf))
self.buf = []
else:
self.buf.append(msg)
def flush(self):
pass
# To access the original stdout/stderr, use sys.__stdout__/sys.__stderr__
sys.stdout = LoggerWriter(logger.info)
sys.stderr = LoggerWriter(logger.error)
2021-02-17 13:15:22,956 - ERROR - ZeroDivisionError: division by zero
对于低于Python 3.9的版本，您可以将 replace 替换.removesuffix('\n')为不太准确的.rstrip('\n').
于 2021-02-15T13:53:44.973 回答
5
在 Vinay Sajip 的回答中添加了同花顺：
class LoggerWriter:
def __init__(self, logger, level):
self.logger = logger
self.level = level
def write(self, message):
if message != '\n':
self.logger.log(self.level, message)
def flush(self):
pass
于 2016-08-29T18:28:14.680 回答
4
快速但脆弱的单线
sys.stdout.write = logger.info
sys.stderr.write = logger.error
这样做只是将记录器函数分配给 stdout/stderr.write调用，这意味着任何写入调用都将调用记录器函数。
这种方法的缺点是调用.write和记录器函数通常都会添加一个换行符，因此您最终会在日志文件中添加额外的行，这可能会或可能不会成为问题，具体取决于您的用例。
另一个陷阱是，如果您的记录器写入 stderr 本身，我们会得到无限递归（堆栈溢出错误）。所以只输出到文件。
于 2021-02-09T21:53:34.403 回答
0
解决 StreamHandler 导致无限递归的问题
我的记录器导致了无限递归，因为 Streamhandler 试图写入标准输出，它本身就是一个记录器 -> 导致无限递归。
解决方案
仅恢复 StreamHandler 的原始sys.__stdout__版本，以便您仍然可以看到终端中显示的日志。
class DefaultStreamHandler(logging.StreamHandler):
def __init__(self, stream=sys.__stdout__):
# Use the original sys.__stdout__ to write to stdout
# for this handler, as sys.stdout will write out to logger.
super().__init__(stream)
class LoggerWriter(io.IOBase):
"""Class to replace the stderr/stdout calls to a logger"""
def __init__(self, logger_name: str, log_level: int):
""":param logger_name: Name to give the logger (e.g. 'stderr')
:param log_level: The log level, e.g. logging.DEBUG / logging.INFO that
the MESSAGES should be logged at.
"""
self.std_logger = logging.getLogger(logger_name)
# Get the "root" logger from by its name (i.e. from a config dict or at the bottom of this file)
# We will use this to create a copy of all its settings, except the name
app_logger = logging.getLogger("myAppsLogger")
[self.std_logger.addHandler(handler) for handler in app_logger.handlers]
self.std_logger.setLevel(app_logger.level) # the minimum lvl msgs will show at
self.level = log_level # the level msgs will be logged at
self.buffer = []
def write(self, msg: str):
"""Stdout/stderr logs one line at a time, rather than 1 message at a time.
Use this function to aggregate multi-line messages into 1 log call."""
msg = msg.decode() if issubclass(type(msg), bytes) else msg
if not msg.endswith("\n"):
return self.buffer.append(msg)
self.buffer.append(msg.rstrip("\n"))
message = "".join(self.buffer)
self.std_logger.log(self.level, message)
self.buffer = []
def replace_stderr_and_stdout_with_logger():
"""Replaces calls to sys.stderr -> logger.info & sys.stdout -> logger.error"""
# To access the original stdout/stderr, use sys.__stdout__/sys.__stderr__
sys.stdout = LoggerWriter("stdout", logging.INFO)
sys.stderr = LoggerWriter("stderr", logging.ERROR)
if __name__ == __main__():
# Load the logger & handlers
logger = logging.getLogger("myAppsLogger")
logger.setLevel(logging.DEBUG)
# HANDLER = logging.StreamHandler()
HANDLER = DefaultStreamHandler() # <--- replace the normal streamhandler with this
logger.addHandler(HANDLER)
logFormatter = logging.Formatter("[%(asctime)s] - %(name)s - %(levelname)s - %(message)s")
HANDLER.setFormatter(logFormatter)
# Run this AFTER you load the logger
replace_stderr_and_stdout_with_logger()
replace_stderr_and_stdout_with_logger()然后在你初始化你的记录器（代码的最后一点）之后最后调用
于 2021-10-26T19:21:15.313 回答