{"templateId":"markdown","sharedDataIds":{"sidebar":"sidebar-@l10n/ja/sidebars.yaml"},"props":{"metadata":{"markdoc":{"tagList":[]},"type":"markdown"},"seo":{"title":"JSON形式を使用したログのインポート","description":"JSON形式のログをTreasure Agentで簡単にインポートする方法を解説。td-agentのインストールと設定手順を詳しく説明します。","siteUrl":"https://docs.treasure.ai","lang":"en-US","jsonLd":{"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https://www.treasure.ai/","name":"Treasure AI","url":"https://www.treasure.ai/","logo":"https://www.treasure.ai/hubfs/assets/images/logos/primary-logo.svg"},{"@type":"WebSite","@id":"https://docs.treasure.ai/#website","name":"Treasure AI Documentation","url":"https://docs.treasure.ai/","inLanguage":["en","ja"],"publisher":{"@id":"https://www.treasure.ai/"}}]},"llmstxt":{"hide":false,"sections":[{"title":"Table of contents","includeFiles":["**/*"],"excludeFiles":[]}],"excludeFiles":[]}},"dynamicMarkdocComponents":[],"compilationErrors":[],"ast":{"$$mdtype":"Tag","name":"article","attributes":{},"children":[{"$$mdtype":"Tag","name":"Heading","attributes":{"level":1,"id":"json形式を使用したログのインポート","__idx":0},"children":["JSON形式を使用したログのインポート"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["Treasure Agent(td-agent)からJSON形式のログをインポートして、アクセスログをクラウドに継続的にインポートできます。"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["td-agentはログローテーションを処理します"]},"。td-agentはログの最終位置の記録を保持し、td-agentプロセスがダウンした場合でも、各行が正確に1回だけ読み取られることを保証します。ただし、情報はファイルに保存されるため、ファイルが破損すると「正確に1回」の保証が破られます。"]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"前提条件","__idx":1},"children":["前提条件"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"code","attributes":{},"children":["td-agent:td-agent"]},"には、ログを読み取る権限が必要です。"]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"td-agentのインストール","__idx":2},"children":["td-agentのインストール"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["td-agentは",{"$$mdtype":"Tag","name":"MarkdownLink","attributes":{"href":"http://fluentd.org/"},"children":["Fluentdプロジェクト"]},"の下にあります。td-agentは、Treasure Data用のカスタムプラグインでFluentdを拡張します。"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["アプリケーションサーバーに'td-agent'をインストールする必要があります。td-agentは、あらゆる種類の時系列データのストリーミングアップロード専用のデーモンプログラムです。td-agentはTreasure Dataによって開発・維持されています。"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["td-agentをセットアップするには、以下の記事を参照してください。Linuxシステム用のdeb/rpmパッケージを提供しています。"]},{"$$mdtype":"Tag","name":"div","attributes":{"className":"md-table-wrapper"},"children":[{"$$mdtype":"Tag","name":"table","attributes":{"className":"md"},"children":[{"$$mdtype":"Tag","name":"thead","attributes":{},"children":[{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"th","attributes":{"data-label":"環境"},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["環境"]}]},{"$$mdtype":"Tag","name":"th","attributes":{"data-label":"参照先"},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["参照先"]}]}]}]},{"$$mdtype":"Tag","name":"tbody","attributes":{},"children":[{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"td","attributes":{},"children":["MacOS X"]},{"$$mdtype":"Tag","name":"td","attributes":{},"children":[{"$$mdtype":"Tag","name":"MarkdownLink","attributes":{"href":"https://docs.fluentd.org/installation/install-fluent-package/install-by-dmg-fluent-package"},"children":["MacOS Xへのtd-agentのインストール"]}]}]},{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"td","attributes":{},"children":["Ubuntuシステム"]},{"$$mdtype":"Tag","name":"td","attributes":{},"children":[{"$$mdtype":"Tag","name":"MarkdownLink","attributes":{"href":"https://docs.fluentd.org/installation/install-fluent-package/install-by-deb-fluent-package"},"children":["DebianおよびUbuntu用のtd-agentのインストール"]}]}]},{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"td","attributes":{},"children":["RHEL / CentOSシステム"]},{"$$mdtype":"Tag","name":"td","attributes":{},"children":[{"$$mdtype":"Tag","name":"MarkdownLink","attributes":{"href":"https://docs.fluentd.org/installation/install-by-rpm"},"children":["RedhatおよびCentOS用のtd-agentのインストール"]}]}]},{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"td","attributes":{},"children":["AWS Elastic Beanstalk"]},{"$$mdtype":"Tag","name":"td","attributes":{},"children":[{"$$mdtype":"Tag","name":"MarkdownLink","attributes":{"href":"https://github.com/treasure-data/elastic-beanstalk-td-agent"},"children":["AWS Elastic Beanstalkへのtd-agentのインストール"]}]}]}]}]}]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"td-agentconfの変更","__idx":3},"children":["td-agent.confの変更"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"code","attributes":{},"children":["apikey"]},"オプションを設定して、認証キーを指定します。API keyはTreasure コンソールから確認できます。"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["/etc/td-agent/td-agent.confにアクセスして、",{"$$mdtype":"Tag","name":"code","attributes":{},"children":["apikey"]},"オプションを設定します。"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"em","attributes":{},"children":["YOUR_API_KEY"]},"は、あなたのAPI key文字列である必要があります。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"data-language":"conf","header":{"controls":{"copy":{}}},"source":"# Tailing the JSON formatted Logs\n<source>\n  type tail\n  format json\n  tag td.production.foo\n  path /path/to/the/file/foo.json\n  pos_file /var/log/td-agent/foo.pos\n</source>\n\n# Treasure Data Input and Output\n<match td.*.*>\n  type tdlog\n  endpoint api.treasuredata.com\n  apikey YOUR_API_KEY\n  auto_create_table\n  buffer_type file\n  buffer_path /var/log/td-agent/buffer/td\n  use_ssl true\n</match>\n","lang":"conf"},"children":[]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["以下の行が設定されたら、agentを再起動します。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"header":{"controls":{"copy":{}}},"source":"$ sudo /etc/init.d/td-agent restart\n"},"children":[]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["td-agentはファイルをテーリングし、ログをバッファリングし(",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["var/log/td-agent/buffer/td"]},")、自動的にログをクラウドにアップロードします。"]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"データインポートの確認","__idx":4},"children":["データインポートの確認"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["以下の例は、サンプルログファイルです。ログファイルに新しい行が追加されるたびに、td-agentはその行を解析し、レコードをバッファに追加します。td-agentは5分ごとにデータをクラウドにアップロードします。データを即座にアップロードするには、SIGUSR1シグナルを送信します。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"data-language":"bash","header":{"controls":{"copy":{}}},"source":"$ tail -n 5 /path/to/the/file/foo.json\n{\"a\"=>\"b\", \"c\"=>\"d\"}\n{\"a\"=>\"b\", \"c\"=>\"d\", \"e\"=>1}\n{\"a\"=>\"b\", \"c\"=>\"d\", \"e\"=>1, \"f\"=>2.0}\n{\"a\"=>\"b\", \"c\"=>\"d\"}\n{\"a\"=>\"b\", \"c\"=>\"d\", \"e\"=>1}\n","lang":"bash"},"children":[]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["すべてが正しく設定されていることを確認するには、以下のコマンドを実行します。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"data-language":"bash","header":{"controls":{"copy":{}}},"source":"# append new entries\n$ tail -n 3 /path/to/the/file/foo.json > sample.txt # ログの最後の3行を取得し...\n$ cat sample.txt >>/path/to/the/file/foo.json       # それらをバッファファイルに追加してtailプラグインをトリガーします。\n\n# flush the buffer\n$ kill -USR1 `cat /var/run/td-agent/td-agent.pid`\n","lang":"bash"},"children":[]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["データが正常にアップロードされたことを確認するには、次のように",{"$$mdtype":"Tag","name":"code","attributes":{},"children":["td tables"]},"コマンドを実行します。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"data-language":"bash","header":{"controls":{"copy":{}}},"source":"td tables\n+------------+------------+------+-----------+\n| Database   | Table      | Type | Count     |\n+------------+------------+------+-----------+\n| production | foo        | log  | 3         |\n+------------+------------+------+-----------+\n","lang":"bash"},"children":[]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["正しく動作しない場合は、",{"$$mdtype":"Tag","name":"code","attributes":{},"children":["/var/log/td-agent.log"]},"を確認してください。",{"$$mdtype":"Tag","name":"code","attributes":{},"children":["td-agent:td-agent"]},"には、ログを読み取る権限が必要です。"]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"次のステップ","__idx":5},"children":["次のステップ"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["従来のRDBMSよりも柔軟なスキーマメカニズムを提供しています。クエリには、Hive Query Languageを活用します。"]},{"$$mdtype":"Tag","name":"ul","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"MarkdownLink","attributes":{"href":"/products/customer-data-platform/data-workbench/databases/schema-management"},"children":["Schema Management"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"MarkdownLink","attributes":{"href":"/products/customer-data-platform/data-workbench/queries/hive/quickstart"},"children":["Hive Query Language"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"MarkdownLink","attributes":{"href":"/tools/cli-and-sdks/api-references-and-tool-references"},"children":["REST APIとそのバインディングによるプログラマティックアクセス"]}]}]}]},"headings":[{"value":"JSON形式を使用したログのインポート","id":"json形式を使用したログのインポート","depth":1},{"value":"前提条件","id":"前提条件","depth":2},{"value":"td-agentのインストール","id":"td-agentのインストール","depth":2},{"value":"td-agent.confの変更","id":"td-agentconfの変更","depth":2},{"value":"データインポートの確認","id":"データインポートの確認","depth":2},{"value":"次のステップ","id":"次のステップ","depth":2}],"frontmatter":{"seo":{"title":"JSON形式を使用したログのインポート","description":"JSON形式のログをTreasure Agentで簡単にインポートする方法を解説。td-agentのインストールと設定手順を詳しく説明します。"}},"lastModified":"2026-06-17T07:22:53.000Z","pagePropGetterError":{"message":"","name":""}},"slug":"/ja/int/logs-import-using-json-format","userData":{"isAuthenticated":false,"teams":["anonymous"]},"isPublic":true}