{"templateId":"markdown","sharedDataIds":{"sidebar":"sidebar-@l10n/ja/sidebars.yaml"},"props":{"metadata":{"markdoc":{"tagList":[]},"type":"markdown"},"seo":{"title":"Microsoft Azure Blob Storage Import Integration","description":"Treasure Data Product Documentation · Collect and Unify · Segment and Activate · Experiment and Analyze · Decisioning Automate with AI Scale and Trust.","siteUrl":"https://docs.treasuredata.com","lang":"en-US","llmstxt":{"hide":false,"sections":[{"title":"Table of contents","includeFiles":["**/*"],"excludeFiles":[]}],"excludeFiles":[]}},"dynamicMarkdocComponents":[],"compilationErrors":[],"ast":{"$$mdtype":"Tag","name":"article","attributes":{},"children":[{"$$mdtype":"Tag","name":"Heading","attributes":{"level":1,"id":"microsoft-azure-blob-storage-import-integration","__idx":0},"children":["Microsoft Azure Blob Storage Import Integration"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"MarkdownLink","attributes":{"href":"/ja/int/microsoft-azure-blob-storage-export-integration"},"children":["Microsoft Azure Blob Storage Export Integrationの詳細はこちら"]},"をご覧ください。"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["Microsoft Azure Blob Storage用のオープンデータコネクタは、Azure Blob Storageコンテナに保存されている*.tsvおよび*.csvファイルの内容をインポートできます。"]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":1,"id":"制限事項","__idx":1},"children":["制限事項"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["コネクタUIの制限事項"]},"。コネクタUIでの編集には多くの制限があります。編集にはCLIの使用を推奨します。"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["階層型名前空間が有効になっている場合、増分フローは正常に動作しません。"]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"前提条件","__idx":2},"children":["前提条件"]},{"$$mdtype":"Tag","name":"ul","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":["Treasure Dataの基本知識"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":["Microsoft Azure Platformアカウント"]}]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"接続の設定","__idx":3},"children":["接続の設定"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["Microsoft Azure Blob Storage用のDataConnectorは、",{"$$mdtype":"Tag","name":"MarkdownLink","attributes":{"href":"https://console.treasuredata.com/app/connections"},"children":["Connector UI"]},"から送信できます。"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"img","attributes":{"src":"/assets/image-20191015-154021.a5cc6ed2d6c8814d389e469db0eee27e0144a91e90a2a1bb2f1573c020746a54.743883bd.png","alt":""},"children":[]}]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"新しいmicrosoft-azure-blob-storageコネクタの作成","__idx":4},"children":["新しいMicrosoft Azure Blob Storageコネクタの作成"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["まず、以下のパラメータを設定してコネクタを登録する必要があります。"]},{"$$mdtype":"Tag","name":"ul","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Storage Account name"]},":Microsoft Azure Blob Storageアカウントの名前。"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Primary access key:"]}," Microsoft Azure Blob Storageアカウントへのアクセスに使用するアクセスキー。"]}]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"img","attributes":{"src":"/assets/image-20191015-154039.ffdcfb7e9cd7929c00d3c2a69133a08267aff7678c0aa1977b9cacd943b16850.743883bd.png","alt":""},"children":[]}]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["プロキシ設定が有効な場合"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"img","attributes":{"src":"/assets/image2021-9-20_13-54-47.a9d4f91ae596b2cc09993d4d6af92ac72d25a04bbb1af94e1f623422c181929a.743883bd.png","alt":""},"children":[]}]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"microsoft-azure-storageからデータを転送する","__idx":5},"children":["Microsoft Azure Storageからデータを転送する"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["次に、My Connectionsページで「New Transfer」を作成します。アドホックDataConnectorジョブまたはスケジュールDataConnectorジョブを準備できます。以下の手順を実行してください。"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"img","attributes":{"src":"/assets/image-20191015-154058.379b76779f527bd1c574756b4a413be14a62c4ed61182febca7b2ff6f9ad01f4.743883bd.png","alt":""},"children":[]}]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":3,"id":"fetch-from","__idx":6},"children":["Fetch from"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["取り込みたい情報を登録します。"]},{"$$mdtype":"Tag","name":"ul","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Container"]},": Azureクラウドストレージのコンテナ名（例: ",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["your_cont"]},"）"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Path Prefix"]},": ターゲットキーのプレフィックス。（例: ",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["logs/data_"]},"）"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Path Regex"]},": ファイルパスにマッチする正規表現。ファイルパスがこのパターンにマッチしない場合、そのファイルはスキップされます。（例: ",{"$$mdtype":"Tag","name":"em","attributes":{},"children":[".csv$"]}," # この場合、パスがこのパターンにマッチしない場合、ファイルはスキップされます）"]}]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":5,"id":"例-cloudfront","__idx":7},"children":["例: CloudFront"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["Amazon CloudFrontは、静的および動的なWebコンテンツの配信を高速化するWebサービスです。CloudFrontを設定して、CloudFrontが受信するすべてのユーザーリクエストに関する詳細情報を含むログファイルを作成できます。ロギングを有効にすると、次のようなCloudFrontログファイルを保存できます。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"header":{"controls":{"copy":{}}},"source":"[your_bucket] - [logging] - [E231A697YXWD39.2017-04-23-15.a103fd5a.gz]\n[your_bucket] - [logging] - [E231A697YXWD39.2017-04-23-15.b2aede4a.gz]\n[your_bucket] - [logging] - [E231A697YXWD39.2017-04-23-16.594fa8e6.gz]\n[your_bucket] - [logging] - [E231A697YXWD39.2017-04-23-16.d12f42f9.gz]\n"},"children":[]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["この場合、「Fetch from」の設定は以下のようになります。"]},{"$$mdtype":"Tag","name":"ul","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Container"]},": your_container"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Path Prefix"]},": logging/"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Path Regex"]},": ",{"$$mdtype":"Tag","name":"em","attributes":{},"children":[".gz$"]},"（必須ではありません）"]}]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"img","attributes":{"src":"/assets/image-20191015-154114.8752d03745b3b93f6ef2fe555ee753273ac81b6cfccaaca9db12362215dd7591.743883bd.png","alt":""},"children":[]}]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":3,"id":"preview","__idx":8},"children":["Preview"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["設定したデータのプレビューを表示できます。プレビューが表示されない場合、またはプレビューの表示に問題がある場合は、",{"$$mdtype":"Tag","name":"MarkdownLink","attributes":{"href":"mailto:support@treasuredata.com"},"children":["サポート"]},"にお問い合わせください。"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"img","attributes":{"src":"/assets/image-20191209-211644.78d7eda5add6ed363b9050c68fcb1b7e6fcf1a3e0ed6f3f666e792ad54a83013.743883bd.png","alt":""},"children":[]}]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["プレビューコマンドは、指定されたバケットから1つのファイルをダウンロードし、そのファイルから結果を表示します。これにより、プレビューとissueコマンドの結果に違いが生じる可能性があります。"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["特定のカラム名を設定したい場合は、",{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Advanced Settings"]},"を選択してください。"]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":4,"id":"advanced-settings","__idx":9},"children":["Advanced Settings"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["Advanced Settingsでは、推測されたプロパティを編集できます。必要に応じて以下のセクションを編集してください。"]},{"$$mdtype":"Tag","name":"ul","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Default timezone"]},": 値自体にタイムゾーンが含まれていない場合、タイムスタンプカラムのタイムゾーンを変更します。"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Columns"]},":"]},{"$$mdtype":"Tag","name":"ul","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Name"]},": カラム名を変更します。カラム名に使用できる文字は、小文字のアルファベット、数字、「_」（アンダースコア）のみです。"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Type"]},": 値を指定されたタイプとして解析し、そのタイプをTreasure Dataスキーマの一部として保存します。"]},{"$$mdtype":"Tag","name":"ul","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["boolean"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["long"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["timestamp"]},": Treasure DataではString型としてインポートされます（例: 2017-04-01 00:00:00.000）"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["double"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["string"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["json"]}]}]}]}]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Total file count limit"]},": 読み込むファイルの最大数。（オプション）"]}]}]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":3,"id":"transfer-to","__idx":10},"children":["Transfer to"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["このフェーズでは、インポート先のターゲットdatabaseとtableを選択します。",{"$$mdtype":"Tag","name":"code","attributes":{},"children":["Create new database"]},"または",{"$$mdtype":"Tag","name":"code","attributes":{},"children":["Create new table"]},"のチェックボックスを使用して、新しいdatabaseまたはtableを作成できます。"]},{"$$mdtype":"Tag","name":"ul","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Mode"]},": Append – 既存のtableにレコードを追加できます。"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Mode"]},": Replace – tableの既存データを、インポートされるデータで置き換えます。"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Partition key Seed"]},": パーティショニング時間カラムとして使用したいlongまたはtimestampカラムを選択します。時間カラムを指定しない場合、転送のアップロード時間がadd_timeフィルタの追加と併せて使用されます。"]}]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"img","attributes":{"src":"/assets/image-20191015-154201.3b19c127a567d44468ddb9d0ec5b68c35be196f47ea4a1c4c330d9e7eacb0f54.743883bd.png","alt":""},"children":[]}]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":3,"id":"when","__idx":11},"children":["When"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["このフェーズでは、ジョブのアドホックまたはスケジュール設定を行うことができます。"]},{"$$mdtype":"Tag","name":"ul","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":["When"]},{"$$mdtype":"Tag","name":"ul","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Once now"]},": 転送を1回だけ実行します。"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Repeat…"]}]},{"$$mdtype":"Tag","name":"ul","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Schedule"]},": 次の3つのオプションを受け付けます: ",{"$$mdtype":"Tag","name":"code","attributes":{},"children":["@hourly"]},"、",{"$$mdtype":"Tag","name":"code","attributes":{},"children":["@daily"]},"、",{"$$mdtype":"Tag","name":"code","attributes":{},"children":["@monthly"]},"、およびカスタム",{"$$mdtype":"Tag","name":"code","attributes":{},"children":["cron"]},"。"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Delay Transfer"]},": 実行時間に遅延を追加します。"]}]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Data Storage Timezone"]},": データが保存されるタイムゾーン。データはこのタイムゾーンでも表示されます。「Asia/Tokyo」などの拡張タイムゾーン形式をサポートしています。"]}]}]}]}]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"img","attributes":{"src":"/assets/image-20191015-154222.2e3ccc0223d646f83485d513f7eb860b0e0d9c7338cb1df4fdd8cf50f85fb185.743883bd.png","alt":""},"children":[]}]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["頻度を選択した後、",{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Start Transfer"]},"を選択して転送を開始します。エラーがなければ、Treasure Dataへの転送が完了し、データが利用可能になります。転送が実行されると、ジョブが起動されます。JobsセクションまたはMy Input Transfersセクションを使用して、データ転送の進行状況を監視できます。"]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":1,"id":"データインポートのトラブルシューティング","__idx":12},"children":["データインポートのトラブルシューティング"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["ジョブログを確認してください。警告とエラーは、インポートの成功に関する情報を提供します。たとえば、",{"$$mdtype":"Tag","name":"MarkdownLink","attributes":{"href":"https://docs.treasuredata.com/smart/project-product-documentation/data-import-error-troubleshooting"},"children":["インポートエラーに関連するソースファイル名を特定する"]},"ことができます。"]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":1,"id":"cliを使用したコネクタの設定","__idx":13},"children":["CLIを使用したコネクタの設定"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["コマンドラインインターフェイスからMicrosoft Azure Blob Storageデータコネクタを使用することもできます。以下の手順は、CLIを使用してデータをインポートする方法を示しています。"]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"tdコマンド-v0119以降をインストールする","__idx":14},"children":["'td'コマンド v0.11.9以降をインストールする"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["最新の",{"$$mdtype":"Tag","name":"MarkdownLink","attributes":{"href":"https://toolbelt.treasuredata.com/"},"children":["Treasure Data Toolbelt"]},"をインストールしてください。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"header":{"controls":{"copy":{}}},"source":"$ td --version\n0.11.10\n"},"children":[]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"シード設定ファイル-seedyml-の作成","__idx":15},"children":["シード設定ファイル (seed.yml) の作成"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["まず、以下の例のように、アカウント情報を含む ",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["seed.yml"]}," を準備します（",{"$$mdtype":"Tag","name":"MarkdownLink","attributes":{"href":"https://learn.microsoft.com/en-us/azure/storage/common/storage-account-create"},"children":["Azure ストレージアカウントについて"]},"を確認してください）。また、コンテナ名とターゲットファイル名（または複数ファイルのプレフィックス）も指定する必要があります。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"header":{"controls":{"copy":{}}},"source":"in:\n  type: azure_blob_storage\n  account_name: myaccount\n  account_key: myaccount_key\n  container: my-container\n  path_prefix: logs/csv-\nout:\n  mode: append\n"},"children":[]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["Data Connector for Microsoft Azure Blob Storage は、指定されたプレフィックスに一致するすべてのファイルをインポートします。（例: path_prefix: ",{"$$mdtype":"Tag","name":"code","attributes":{},"children":["path/to/sample_"]}," –> ",{"$$mdtype":"Tag","name":"code","attributes":{},"children":["path/to/sample_201501.csv.gz"]},", ",{"$$mdtype":"Tag","name":"code","attributes":{},"children":["path/to/sample_201502.csv.gz"]},", …, ",{"$$mdtype":"Tag","name":"code","attributes":{},"children":["path/to/sample_201505.csv.gz"]},"）"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["利用可能な ",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["out"]}," モードの詳細については、以下の付録を参照してください。"]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"43-フィールドの推測-loadyml-の生成","__idx":16},"children":["4.3. フィールドの推測 (load.yml の生成)"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["次に、",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["connector:guess"]}," を使用します。このコマンドは、ソースファイルを自動的に読み取り、ファイル形式を評価（ロジックを使用して推測）します。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"header":{"controls":{"copy":{}}},"source":"$ td connector:guess seed.yml -o load.yml\n"},"children":[]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"em","attributes":{},"children":["load.yml"]}," を開くと、ファイル形式、エンコーディング、カラム名、型を含む推測されたファイル形式定義が表示されます。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"data-language":"yaml","header":{"controls":{"copy":{}}},"source":"in:\n  type: azure_blob_storage\n  account_name: myaccount\n  account_key: myaccount_key\n  container: my-container\n  path_prefix: logs/csv-\n  decoders:\n  - {type: gzip}\n  parser:\n    charset: UTF-8\n    newline: CRLF\n    type: csv\n    delimiter: ','\n    quote: '\"'\n    header_line: true\n    columns:\n    - {name: id, type: long}\n    - {name: account, type: long}\n    - {name: time, type: timestamp, format: '%Y-%m-%d %H:%M:%S'}\n    - {name: purchase, type: timestamp, format: '%Y%m%d'}\n    - {name: comment, type: string}\nout:\n  mode: append\n","lang":"yaml"},"children":[]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["次に、",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["preview"]}," コマンドを使用して、システムがファイルをどのように解析するかをプレビューできます。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"header":{"controls":{"copy":{}}},"source":"$ td connector:preview load.yml\n+-------+---------+----------+---------------------+\n| id    | company | customer | created_at          |\n+-------+---------+----------+---------------------+\n| 11200 | AA Inc. |    David | 2015-03-31 06:12:37 |\n| 20313 | BB Imc. |      Tom | 2015-04-01 01:00:07 |\n| 32132 | CC Inc. | Fernando | 2015-04-01 10:33:41 |\n| 40133 | DD Inc. |    Cesar | 2015-04-02 05:12:32 |\n| 93133 | EE Inc. |     Jake | 2015-04-02 14:11:13 |\n+-------+---------+----------+---------------------+\n"},"children":[]},{"$$mdtype":"Tag","name":"div","attributes":{"className":"md-table-wrapper"},"children":[{"$$mdtype":"Tag","name":"table","attributes":{"className":"md"},"children":[{"$$mdtype":"Tag","name":"thead","attributes":{},"children":[{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"th","attributes":{"data-label":""},"children":[]}]}]},{"$$mdtype":"Tag","name":"tbody","attributes":{},"children":[{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"td","attributes":{},"children":["guess コマンドは、ソースデータからサンプル行を使用してカラム定義を推測するため、ソースデータファイルに3行以上と2カラム以上が必要です。"]}]}]}]}]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["システムがカラム名またはカラム型を予期せず検出した場合は、",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["load.yml"]}," を直接修正して、再度プレビューしてください。"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["現在、Data Connector は \"boolean\"、\"long\"、\"double\"、\"string\"、および \"timestamp\" 型の解析をサポートしています。"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["データロードジョブを実行する前に、ローカルデータベースとテーブルを作成する必要があります。以下の手順に従ってください。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"header":{"controls":{"copy":{}}},"source":"$ td database:create td_sample_db\n$ td table:create td_sample_db td_sample_table\n"},"children":[]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"44-ロードジョブの実行","__idx":17},"children":["4.4. ロードジョブの実行"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["最後に、ロードジョブを送信します。データのサイズによっては、数時間かかる場合があります。データが格納される Treasure Data データベースとテーブルを指定してください。"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["Treasure Data のストレージは時間によってパーティション化されているため（",{"$$mdtype":"Tag","name":"MarkdownLink","attributes":{"href":"https://docs.treasuredata.com/smart/project-product-documentation/data-partitioning-in-treasure-data"},"children":["データパーティショニング"]},"を参照）、",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["--time-column"]}," オプションを指定することをお勧めします。オプションが指定されていない場合、Data Connector は最初の ",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["long"]}," または ",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["timestamp"]}," カラムをパーティショニング時間として選択します。",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["--time-column"]}," で指定されるカラムの型は、",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["long"]}," および ",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["timestamp"]}," 型のいずれかである必要があります。"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["データに時間カラムがない場合は、",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["add_time"]}," フィルターオプションを使用して時間カラムを追加できます。詳細については、",{"$$mdtype":"Tag","name":"MarkdownLink","attributes":{"href":"https://docs.treasuredata.com/smart/project-product-documentation/add_time-filter-function"},"children":["add_time フィルタープラグイン"]},"を参照してください。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"header":{"controls":{"copy":{}}},"source":"$ td connector:issue load.yml --database td_sample_db --table td_sample_table \\\n  --time-column created_at\n"},"children":[]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["connector:issue コマンドは、",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["database(td_sample_db)"]}," と ",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["table(td_sample_table)"]}," が既に作成されていることを前提としています。データベースまたはテーブルが TD に存在しない場合、connector:issue コマンドは失敗するため、",{"$$mdtype":"Tag","name":"MarkdownLink","attributes":{"href":"https://docs.treasuredata.com/smart/project-product-documentation/data-management"},"children":["手動で"]},"データベースとテーブルを作成するか、",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["td connector:issue"]}," コマンドで ",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["--auto-create-table"]}," オプションを使用してデータベースとテーブルを自動作成してください。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"header":{"controls":{"copy":{}}},"source":"$ td connector:issue load.yml --database td_sample_db --table td_sample_table --time-column created_at --auto-create-table\n"},"children":[]},{"$$mdtype":"Tag","name":"div","attributes":{"className":"md-table-wrapper"},"children":[{"$$mdtype":"Tag","name":"table","attributes":{"className":"md"},"children":[{"$$mdtype":"Tag","name":"thead","attributes":{},"children":[{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"th","attributes":{"data-label":""},"children":[]}]}]},{"$$mdtype":"Tag","name":"tbody","attributes":{},"children":[{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"td","attributes":{},"children":["現在、Data Connector はサーバー側でレコードをソートしません。時間ベースのパーティショニングを効果的に使用するには、事前にファイル内のレコードをソートしてください。"]}]}]}]}]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"em","attributes":{},"children":["time"]}," というフィールドがある場合は、",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["--time-column"]}," オプションを指定する必要はありません。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"header":{"controls":{"copy":{}}},"source":"$ td connector:issue load.yml --database td_sample_db --table td_sample_table\n"},"children":[]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":1,"id":"スケジュール実行","__idx":18},"children":["スケジュール実行"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["増分的な Microsoft Azure Blob Storage ファイルインポートのために、定期的な Data Connector の実行をスケジュールできます。高可用性を確保するために、スケジューラーを慎重に設定しています。この機能を使用することで、ローカルデータセンターに ",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["cron"]}," デーモンが不要になります。"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["スケジュールされたインポートでは、Data Connector for Microsoft Azure Blob Storage は、指定されたプレフィックスに一致するすべてのファイル（例: path_prefix: ",{"$$mdtype":"Tag","name":"code","attributes":{},"children":["path/to/sample_"]}," –> ",{"$$mdtype":"Tag","name":"code","attributes":{},"children":["path/to/sample_201501.csv.gz"]},", ",{"$$mdtype":"Tag","name":"code","attributes":{},"children":["path/to/sample_201502.csv.gz"]},", …, ",{"$$mdtype":"Tag","name":"code","attributes":{},"children":["path/to/sample_201505.csv.gz"]},"）を最初にインポートし、次の実行のために最後のパス（",{"$$mdtype":"Tag","name":"code","attributes":{},"children":["path/to/sample_201505.csv.gz"]},"）を記憶します。"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["2回目以降の実行では、コネクターはアルファベット順（辞書順）で最後のパスの後に来るファイルのみをインポートします（",{"$$mdtype":"Tag","name":"code","attributes":{},"children":["path/to/sample_201506.csv.gz"]},", …）。"]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"スケジュールの作成","__idx":19},"children":["スケジュールの作成"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["新しいスケジュールは、",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["td connector:create"]}," コマンドを使用して作成できます。以下が必要です: スケジュールの名前、cron スタイルのスケジュール、データが格納されるデータベースとテーブル、および Data Connector 設定ファイル。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"header":{"controls":{"copy":{}}},"source":"$ td connector:create \\\n    daily_import \\\n    \"10 0 * * *\" \\\n    td_sample_db \\\n    td_sample_table \\\n    load.yml\n"},"children":[]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["Treasure Data のストレージは時間によってパーティション化されているため（",{"$$mdtype":"Tag","name":"MarkdownLink","attributes":{"href":"https://docs.treasuredata.com/smart/project-product-documentation/data-partitioning-in-treasure-data"},"children":["データパーティショニング"]},"を参照）、",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["--time-column"]}," オプションを指定することをお勧めします。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"header":{"controls":{"copy":{}}},"source":"$ td connector:create \\    daily_import \\\n    \"10 0 * * *\" \\\n    td_sample_db \\\n    td_sample_table \\\n    load.yml \\\n    --time-column created_at\n"},"children":[]},{"$$mdtype":"Tag","name":"div","attributes":{"className":"md-table-wrapper"},"children":[{"$$mdtype":"Tag","name":"table","attributes":{"className":"md"},"children":[{"$$mdtype":"Tag","name":"thead","attributes":{},"children":[{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"th","attributes":{"data-label":""},"children":[]}]}]},{"$$mdtype":"Tag","name":"tbody","attributes":{},"children":[{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"td","attributes":{},"children":[{"$$mdtype":"Tag","name":"code","attributes":{},"children":["cron"]},"パラメータは、",{"$$mdtype":"Tag","name":"code","attributes":{},"children":["@hourly"]},"、",{"$$mdtype":"Tag","name":"code","attributes":{},"children":["@daily"]},"、",{"$$mdtype":"Tag","name":"code","attributes":{},"children":["@monthly"]},"の3つの特別なオプションも受け付けます。"]}]}]}]}]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["| --- |"]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"スケジュールの一覧表示","__idx":20},"children":["スケジュールの一覧表示"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"em","attributes":{},"children":["td connector:list"]},"コマンドを実行することで、現在スケジュールされているエントリの一覧を確認できます。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"header":{"controls":{"copy":{}}},"source":"$ td connector:list\n+--------------+------------+----------+-------+--------------+-----------------+-------------------------------------------+\n| Name         | Cron       | Timezone | Delay | Database     | Table           | Config                                    |\n+--------------+------------+----------+-------+--------------+-----------------+-------------------------------------------+\n| daily_import | 10 0 * * * | UTC      | 0     | td_sample_db | td_sample_table | {\"in\"=>{\"type\"=>\"azure_blob_storage\", ... |\n+--------------+------------+----------+-------+--------------+-----------------+-------------------------------------------+\n"},"children":[]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"設定とスケジュール履歴の表示","__idx":21},"children":["設定とスケジュール履歴の表示"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"em","attributes":{},"children":["td connector:show"]},"は、スケジュールエントリの実行設定を表示します。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"header":{"controls":{"copy":{}}},"source":"% td connector:show daily_import\nName     : daily_import\nCron     : 10 0 * * *\nTimezone : UTC\nDelay    : 0\nDatabase : td_sample_db\nTable    : td_sample_table\n"},"children":[]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"em","attributes":{},"children":["td connector:history"]},"は、スケジュールエントリの実行履歴を表示します。各実行の結果を調査するには、",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["td job jobid"]},"を使用します。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"header":{"controls":{"copy":{}}},"source":"% td connector:history daily_import\n+--------+---------+---------+--------------+-----------------+----------+---------------------------+----------+\n| JobID  | Status  | Records | Database     | Table           | Priority | Started                   | Duration |\n+--------+---------+---------+--------------+-----------------+----------+---------------------------+----------+\n| 578066 | success | 10000   | td_sample_db | td_sample_table | 0        | 2015-04-18 00:10:05 +0000 | 160      |\n| 577968 | success | 10000   | td_sample_db | td_sample_table | 0        | 2015-04-17 00:10:07 +0000 | 161      |\n| 577914 | success | 10000   | td_sample_db | td_sample_table | 0        | 2015-04-16 00:10:03 +0000 | 152      |\n| 577872 | success | 10000   | td_sample_db | td_sample_table | 0        | 2015-04-15 00:10:04 +0000 | 163      |\n| 577810 | success | 10000   | td_sample_db | td_sample_table | 0        | 2015-04-14 00:10:04 +0000 | 164      |\n| 577766 | success | 10000   | td_sample_db | td_sample_table | 0        | 2015-04-13 00:10:04 +0000 | 155      |\n| 577710 | success | 10000   | td_sample_db | td_sample_table | 0        | 2015-04-12 00:10:05 +0000 | 156      |\n| 577610 | success | 10000   | td_sample_db | td_sample_table | 0        | 2015-04-11 00:10:04 +0000 | 157      |\n+--------+---------+---------+--------------+-----------------+----------+---------------------------+----------+\n8 rows in set\n"},"children":[]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"スケジュールの削除","__idx":22},"children":["スケジュールの削除"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"em","attributes":{},"children":["td connector:delete"]},"は、スケジュールを削除します。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"header":{"controls":{"copy":{}}},"source":"$ td connector:delete daily_import\n"},"children":[]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":1,"id":"付録","__idx":23},"children":["付録"]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"a-outプラグインのモード","__idx":24},"children":["A) outプラグインのモード"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["seed.ymlの",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["out"]},"セクションでファイルインポートモードを指定できます。"]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":3,"id":"appendデフォルト","__idx":25},"children":["append（デフォルト）"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["これはデフォルトのモードで、レコードはターゲットテーブルに追加されます。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"header":{"controls":{"copy":{}}},"source":"in:\n  ...\nout:\n  mode: append\n"},"children":[]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":3,"id":"replacetd-01110以降","__idx":26},"children":["replace（td 0.11.10以降）"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["このモードは、ターゲットテーブルのデータを置き換えます。このモードでは、ターゲットテーブルに対して手動で行ったスキーマ変更はそのまま保持されることに注意してください。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"header":{"controls":{"copy":{}}},"source":"in:\n  ...\nout:\n  mode: replace\n"},"children":[]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"b-プロキシ設定","__idx":27},"children":["B) プロキシ設定"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"header":{"controls":{"copy":{}}},"source":"in:\n  type: azure_blob_storage\n  account_name: myaccount\n  account_key: myaccount_key\n  container: my-container\n  path_prefix: logs/csv-\n  proxy:\n\ttype: http\n\thost: 201.202.203.10\n\tport: 8080\n\tuser: test\n\tpassword: test\n"},"children":[]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"b-最終パスによる増分ロード","__idx":28},"children":["B) 最終パスによる増分ロード"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"header":{"controls":{"copy":{}}},"source":"in:      type: azure_blob_storage  account_name: myaccount  account_key: myaccount_key  container: my-container  path_prefix: logs/csv-  incremental: true  use_modified_time: false  last_path: logs/csv-123.csv\n"},"children":[]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"c-最終更新時刻による増分ロード","__idx":29},"children":["C) 最終更新時刻による増分ロード"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"header":{"controls":{"copy":{}}},"source":"in:      type: azure_blob_storage  account_name: myaccount  account_key: myaccount_key  container: my-container  path_prefix: logs/csv-  incremental: true  use_modified_time: true  last_modified_time: 2025-04-09T00:00:00.000Z\n"},"children":[]}]},"headings":[{"value":"Microsoft Azure Blob Storage Import Integration","id":"microsoft-azure-blob-storage-import-integration","depth":1},{"value":"制限事項","id":"制限事項","depth":1},{"value":"前提条件","id":"前提条件","depth":2},{"value":"接続の設定","id":"接続の設定","depth":2},{"value":"新しいMicrosoft Azure Blob Storageコネクタの作成","id":"新しいmicrosoft-azure-blob-storageコネクタの作成","depth":2},{"value":"Microsoft Azure Storageからデータを転送する","id":"microsoft-azure-storageからデータを転送する","depth":2},{"value":"Fetch from","id":"fetch-from","depth":3},{"value":"例: CloudFront","id":"例-cloudfront","depth":5},{"value":"Preview","id":"preview","depth":3},{"value":"Advanced Settings","id":"advanced-settings","depth":4},{"value":"Transfer to","id":"transfer-to","depth":3},{"value":"When","id":"when","depth":3},{"value":"データインポートのトラブルシューティング","id":"データインポートのトラブルシューティング","depth":1},{"value":"CLIを使用したコネクタの設定","id":"cliを使用したコネクタの設定","depth":1},{"value":"'td'コマンド v0.11.9以降をインストールする","id":"tdコマンド-v0119以降をインストールする","depth":2},{"value":"シード設定ファイル (seed.yml) の作成","id":"シード設定ファイル-seedyml-の作成","depth":2},{"value":"4.3. フィールドの推測 (load.yml の生成)","id":"43-フィールドの推測-loadyml-の生成","depth":2},{"value":"4.4. ロードジョブの実行","id":"44-ロードジョブの実行","depth":2},{"value":"スケジュール実行","id":"スケジュール実行","depth":1},{"value":"スケジュールの作成","id":"スケジュールの作成","depth":2},{"value":"スケジュールの一覧表示","id":"スケジュールの一覧表示","depth":2},{"value":"設定とスケジュール履歴の表示","id":"設定とスケジュール履歴の表示","depth":2},{"value":"スケジュールの削除","id":"スケジュールの削除","depth":2},{"value":"付録","id":"付録","depth":1},{"value":"A) outプラグインのモード","id":"a-outプラグインのモード","depth":2},{"value":"append（デフォルト）","id":"appendデフォルト","depth":3},{"value":"replace（td 0.11.10以降）","id":"replacetd-01110以降","depth":3},{"value":"B) プロキシ設定","id":"b-プロキシ設定","depth":2},{"value":"B) 最終パスによる増分ロード","id":"b-最終パスによる増分ロード","depth":2},{"value":"C) 最終更新時刻による増分ロード","id":"c-最終更新時刻による増分ロード","depth":2}],"frontmatter":{"seo":{"title":"Microsoft Azure Blob Storage Import Integration"}},"lastModified":"2026-03-09T05:24:00.000Z","pagePropGetterError":{"message":"","name":""}},"slug":"/ja/int/microsoft-azure-blob-storage-import-integration","userData":{"isAuthenticated":false,"teams":["anonymous"]},"isPublic":true}