YouTip

## Python3 Standard Library Overview The Python standard library is very extensive, offering a wide range of components. Using the standard library allows you to easily accomplish various tasks. Here are some modules in the Python3 standard library: * **os module**: The os module provides many functions for interacting with the operating system, such as creating, moving, and deleting files and directories, as well as accessing environment variables. * **sys module**: The sys module provides functions related to the Python interpreter and the system, such as the interpreter's version and path, and information related to stdin, stdout, and stderr. * **time module**: The time module provides functions for handling time, such as getting the current time, formatting dates and times, and timing. * **datetime module**: The datetime module provides more advanced date and time handling functions, such as handling time zones, calculating time differences, and calculating date differences. * **random module**: The random module provides functions for generating random numbers, such as generating random integers, floats, sequences, etc. * **math module**: The math module provides mathematical functions, such as trigonometric functions, logarithmic functions, exponential functions, constants, etc. * **re module**: The re module provides regular expression processing functions, which can be used for text search, replacement, splitting, etc. * **json module**: The json module provides JSON encoding and decoding functions, which can convert Python objects to JSON format and parse Python objects from JSON format. * **urllib module**: The urllib module provides functions for accessing web pages and handling URLs, including downloading files, sending POST requests, handling cookies, etc. ## Operating System Interface The os module provides many functions associated with the operating system, such as file and directory operations. ## Example ```python import os # Get the current working directory current_dir = os.getcwd() print("Current working directory:", current_dir) # List files in the directory files = os.listdir(current_dir) print("Files in the directory:", files) It is recommended to use the `import os` style rather than `from os import *` to ensure that the **os.open()** function, which varies with the operating system, does not override the built-in `open()` function. When using large modules like `os`, the built-in `dir()` and `help()` functions are very useful: ```python >>> import os >>> dir(os) # returns a list of all module functions >>> help(os) # returns an extensive manual page created from the module's docstrings For daily file and directory management tasks, the `shutil` module provides an easy-to-use high-level interface: ```python >>> import shutil >>> shutil.copyfile('data.db', 'archive.db') >>> shutil.move('/build/executables', 'installdir') --- ## File Wildcards The `glob` module provides a function to generate file lists from directory wildcard searches: ## Example ```python >>> import glob >>> glob.glob('*.py') ['primes.py', 'random.py', 'quote.py'] --- ## Command Line Arguments General-purpose utility scripts often invoke command line arguments. These arguments are stored in the `sys` module's `argv` variable as a linked list. For example, after executing "python demo.py one two three" on the command line, you can get the following output: ## Example ```python >>> import sys >>> print(sys.argv) ['demo.py', 'one', 'two', 'three'] --- ## Error Output Redirection and Program Termination `sys` also has `stdin`, `stdout`, and `stderr` attributes. The latter can be used to display warning and error messages even when `stdout` is redirected. ## Example ```python >>> sys.stderr.write('Warning, log file not found starting a new onen') Warning, log file not found starting a new one Most scripts terminate by redirecting using `sys.exit()`. --- ## String Regular Matching The **re** module provides regular expression tools for advanced string processing. For complex matching and processing, regular expressions provide a concise and optimized solution: ## Example ```python >>> import re >>> re.findall(r'b f*', 'which foot or hand fell fastest') ['foot', 'fell', 'fastest'] >>> re.sub(r'(b+) 1', r'1', 'cat in the the hat') 'cat in the hat' If you only need simple functionality, you should first consider string methods because they are very simple, easy to read, and debug: ```python >>> 'tea for too'.replace('too', 'two') 'tea for two' --- ## Mathematics The **math** module provides access to the underlying C function library for floating-point operations: ## Example ```python >>> import math >>> math.cos(math.pi / 4) 0.70710678118654757 >>> math.log(1024, 2) 10.0 The **random** module provides tools for generating random numbers. ## Example ```python >>> import random >>> random.choice(['apple', 'pear', 'banana']) 'apple' >>> random.sample(range(100), 10) # sampling without replacement [30, 83, 16, 4, 8, 81, 41, 50, 18, 33] >>> random.random() # random float 0.17970987693706186 >>> random.randrange(6) # random integer chosen from range(6) 4 --- ## Accessing the Internet Several modules are used to access the Internet and handle network communication protocols. The two simplest are `urllib.request` for handling data received from URLs and `smtplib` for sending emails: ## Example ```python >>> from urllib.request import urlopen >>> for line in urlopen('http://tycho.usno.navy.mil/cgi-bin/timer.pl'): ... line = line.decode('utf-8') # Decoding the binary data to text. ... if 'EST' in line or 'EDT' in line: # look for Eastern Time ... print(line) Nov. 25, 09:43:32 PM EST >>> import smtplib >>> server = smtplib.SMTP('localhost') >>> server.sendmail('soothsayer@example.org', 'jcaesar@example.org', ... """To: jcaesar@example.org ... From: soothsayer@example.org ... ... Beware the Ides of March. ... """) >>> server.quit() Note that the second example requires a running mail server locally. --- ## Dates and Times The **datetime** module provides both simple and complex methods for date and time handling. While supporting date and time algorithms, the implementation focuses on more efficient processing and formatted output. ## Example ```python import datetime # Get current date and time current_datetime = datetime.datetime.now() print(current_datetime) # Get current date current_date = datetime.date.today() print(current_date) # Format date formatted_datetime = current_datetime.strftime("%Y-%m-%d %H:%M:%S") print(formatted_datetime) # Output: 2023-07-17 15:30:45 The output is: 2023-07-17 18:37:56.036914 2023-07-17 2023-07-17 18:37:56 This module also supports time zone handling: ```python >>> from datetime import date >>> now = date.today() # current date >>> now datetime.date(2023, 7, 17) >>> now.strftime("%m-%d-%y. %d %b %Y is a %A on the %d day of %B.") '07-17-23. 17 Jul 2023 is a Monday on the 17 day of July.' >>> # Create a date object representing a birthday >>> birthday = date(1964, 7, 31) >>> age = now - birthday # calculate the time difference between two dates >>> age.days # the days attribute of the age variable, representing the number of days in the time difference 21535 --- ## Data Compression The following modules directly support common data packing and compression formats: `zlib`, `gzip`, `bz2`, `zipfile`, and `tarfile`. ```python >>> import zlib >>> s = b'witch which has which witches wrist watch' >>> len(s) 41 >>> t = zlib.compress(s) >>> len(t) 37 >>> zlib.decompress(t) b'witch which has which witches wrist watch' >>> zlib.crc32(s) 226805979 --- ## Performance Measurement Some users are interested in understanding the performance differences between different methods of solving the same problem. Python provides a measurement tool that gives direct answers to these questions. For example, using tuple packing and unpacking to swap elements seems much more tempting than using traditional methods, and `timeit` proves that the modern method is faster. ```python >>> from timeit import Timer >>> Timer('t=a; a=b; b=t', 'a=1; b=2').timeit() 0.57535828626024577 >>> Timer('a,b = b,a', 'a=1; b=2').timeit() 0.54962537085770791 Compared to the fine-grained `timeit`, the `profile` and `pstats` modules provide time measurement tools for larger code blocks. --- ## Testing Modules One way to develop high-quality software is to develop test code for each function and test frequently during the development process. The `doctest` module provides a tool that scans a module and executes tests based on the embedded docstrings in the program. Tests are constructed by simply cutting and pasting their output into the docstrings. Through user-provided examples, it reinforces the documentation and allows the `doctest` module to confirm whether the code's results match the documentation: ```python def average(values): """Computes the arithmetic mean of a list of numbers. >>> print(average([20, 30, 70])) 40.0 """ return sum(values) / len(values) import doctest doctest.testmod() # automatically validate embedded tests The `unittest` module is not as easy to use as the `doctest` module, but it can provide a more comprehensive test suite in a separate file: ```python import unittest class TestStatisticalFunctions(unittest.TestCase): def test_average(self): self.assertEqual(average([20, 30, 70]), 40.0) self.assertEqual(round(average([1, 5, 7]), 1), 4.3) self.assertRaises(ZeroDivisionError, average, []) self.assertRaises(TypeError, average, 20, 30, 70) unittest.main() # Calling from the command line invokes all tests The above are just some of the modules in the Python3 standard library. Many other modules can be found in the official documentation: [https://docs.python.org/3/library/index.html](https://docs.python.org/3/library/index.html)