Python

I love VanGohan, who is a Japanese meal kits provider in Vancouver. Their meal kits are really tasty and authentic Japanese foods. I can’t live without them. When I visited Japan last year, I wasn’t too eager to find nice Japanese restaurants because of them.

2024-01-26

Recently, I released tabula-py 2.8.0. It is a major release because it uses jpype to launch JVM. This means that it reduces JVM launch time since jpype reuse JVM via JNI. How fast is it? I measured read_pdf_with_template function execution time, which repeatedly launches Java process in the previous version.

2023-09-09

This is what I learned from creating a Python CLI (digdaglog2sql) in a day. In just 4 steps, you can release a CLI written in Python easily. Create a project by using poetry Poetry is a modern Python packaging and dependency management tool. Poetry is becoming popular and defacto rapidly.

2022-05-20

This article show how to develop a digdag Python workflow task efficiently.

2020-03-05

Table of Contents workflowをpushするまえにローカル環境で開発とテストをする方法 基本戦略:Pythonのタスクを合理的な粒度にまとめる 1. Treasure Dataの公式Dockerイメージを使う 2. Dockerイメージと同様のPythonの仮想環境を作る py> operatorを含んだworkflowをローカルで実行する 1. digdagの引数を使う 2. 環境変数を使う 3. digdagの変数を使う PythonやOSのパッケージのインストール方法 py> operatorを含むディレクトリ構成 実行時のエラーを通知する まとめ この記事は、Arm Treasure Data Advent Calendar 2019の24日目です。

2019-12-24

Photo by Hitesh Choudhary on Unsplash Recently, I changed my CI from Travis to GitHub Actions. GitHub Actions is handy and useful for testing, publishing Python packages. Testing Python code on GitHub Actions Migration from Travis is super easy, just writing a simple workflow like:

2019-11-26

Yesterday, PyPI was renewed to the next-generation site. It is modern and stylish one. @aodag told me that PEP 566, which was accepted Feb. 2018, allows us for a document on PyPI to use not only reStructuredText but also other formats such as Markdown.

2018-04-17

長い間、Pythonでパッケージを作った場合、構造化されたドキュメントを使う場合は、reStructuredText (reST)でドキュメントを書く必要がありました。

2018-04-17

Python is a very famous programming language for machine learning. In this article, I will introduce basic Python environment. Glossary I will introduce basic terms about Python package management. pip: A tool for package installation. It retrieves Python packages from PyPI. pip is gem command of Ruby. virtualenv: Package isolation tool for Python. It has similar function with bundler of Ruby, but it also has the function to change Python versions over 2.x and 3.x. venv: It is an official tool for package isolation introduced from Python 3.3. But, if you want to use Python 2.x or you are Debian/Ubuntu user, I recommend you to use virtualenv. venv switches with a command like python3.5 -m venv some-awesome-env, so it can’t handle over Python 2 and 3. venv installed by Debian/Ubuntu installs useless dependencies for other OSs, so I’m an Ubuntu user so I don’t use venv.

2017-08-30

先日、 kawasaki.rb の懇親会で「AWS LambdaのためにPythonはじめたいんです」とか「機械学習系の本を読み始めたので、そこに書いてあったcondaではじめました」とかいう話を聞きました。

2017-08-26