{"templateId":"markdown","sharedDataIds":{"sidebar":"sidebar-@l10n/ja/sidebars.yaml"},"props":{"metadata":{"markdoc":{"tagList":[]},"type":"markdown"},"seo":{"title":"Microsoft Azure Data Lake Storage Import Integration","description":"Treasure Data Product Documentation · Collect and Unify · Segment and Activate · Experiment and Analyze · Decisioning Automate with AI Scale and Trust.","siteUrl":"https://docs.treasuredata.com","lang":"en-US","llmstxt":{"hide":false,"sections":[{"title":"Table of contents","includeFiles":["**/*"],"excludeFiles":[]}],"excludeFiles":[]}},"dynamicMarkdocComponents":[],"compilationErrors":[],"ast":{"$$mdtype":"Tag","name":"article","attributes":{},"children":[{"$$mdtype":"Tag","name":"Heading","attributes":{"level":1,"id":"microsoft-azure-data-lake-storage-import-integration","__idx":0},"children":["Microsoft Azure Data Lake Storage Import Integration"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["Microsoft Azure Data Lake Storageは、ビッグデータ向けの業界をリードするストレージソリューションです。このインポート統合により、Azure Data Lake StorageからParquetファイルをTreasure Dataに取り込み、Treasure Dataで設定された他のデータソースと統合することができます。"]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"この統合で何ができるか","__idx":1},"children":["この統合で何ができるか？"]},{"$$mdtype":"Tag","name":"ul","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["既存のすべてのデータファイルをコピー"]},": Azure Data LakeのすべてのParquetファイルをTreasure Dataにコピーして、システムから移行できます。"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["データを直接取り込む"]},": ブリッジシステムを使用することなく、Azure Data LakeからTreasure Dataへ直接データをインポートします。"]}]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"前提条件","__idx":2},"children":["前提条件"]},{"$$mdtype":"Tag","name":"ul","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":["Treasure Dataの基本知識"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":["Microsoft Azure Data Lakeの基本知識"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":["Shared Access Signaturesの作成とファイルのダウンロードに十分な権限を持つMicrosoft Azure Data Lakeアカウント"]}]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"制限事項","__idx":3},"children":["制限事項"]},{"$$mdtype":"Tag","name":"ul","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":["Azure Data Lake Storage (v2) のみをサポート"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":["Spark Partition (",{"$$mdtype":"Tag","name":"MarkdownLink","attributes":{"href":"https://spark.apache.org/docs/latest/sql-data-sources-parquet.html#partition-discovery"},"children":["https://spark.apache.org/docs/latest/sql-data-sources-parquet.html#partition-discovery"]},") として1レベルのパーティションキーのみをサポート"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":["snappy圧縮コーデックのみをサポート"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":["ダウンロードとParquetファイルスキーマの読み取りに時間がかかるため、データプレビューは利用できません"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":["HTTP Proxyメソッドのみをサポート"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":["AzureのBlobStorageEventsまたはSoftDeleteはサポートされません"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":["deltaファイル形式はサポートされません。（CSVやTVSなどの他の一般的なファイル形式については、Microsoft Azure Blob Storageを使用してください）"]}]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["Parquetファイルサイズに関する推奨事項"]},{"$$mdtype":"Tag","name":"ul","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":["Treasure Dataでは、Row Group Sizeを3.4GB未満に制限することを推奨しています。Row Group Sizeが3.4GBより大きい場合、インポートジョブで「Out of Memory」エラーが発生する可能性があります。"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["これが発生した場合は、データをより小さなParquetファイルサイズに再パーティション化してから、インポートジョブを再試行する必要があります。"]}]}]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"microsoft-azure-portalからaccess-keyまたはshared-access-signatureを取得する","__idx":4},"children":["Microsoft Azure PortalからAccess KeyまたはShared Access Signatureを取得する"]},{"$$mdtype":"Tag","name":"ol","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":["Azure PortalでStorage Accountの管理画面に移動します"," ",{"$$mdtype":"Tag","name":"img","attributes":{"src":"/assets/image2021-9-10_13-50-26.8681dfcfe52df8be55de9a9057745c441f0386bc3bbe7d44fd542a25e117a012.be2392e9.png","alt":""},"children":[]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":["Access keysまたはShared access signaturesを選択します"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":["TD認証設定で使用するためにキーをコピーします"]}]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"treasure-コンソールを使用して接続を作成する","__idx":5},"children":["Treasure コンソールを使用して接続を作成する"]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":3,"id":"新しい接続を作成する","__idx":6},"children":["新しい接続を作成する"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["Treasure Dataでは、クエリを実行する前にデータ接続を作成して設定する必要があります。データ接続の一部として、統合にアクセスするための認証情報を提供します。"]},{"$$mdtype":"Tag","name":"ol","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":["Treasure コンソールを開きます。"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":["Integrations Hub > Catalogに移動します。"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":["Catalog画面の右端にある検索アイコンをクリックして、「Azure Lake」と入力します。"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":["Microsoft Azure Data Lakeコネクタにカーソルを合わせて、Create Authenticationを選択します。"," ",{"$$mdtype":"Tag","name":"img","attributes":{"src":"/assets/msazurelake.aaed38ee4d153a8565b6ddef84296c06764d2bbc14f918d9dacf1a27da62c307.be2392e9.png","alt":""},"children":[]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":["以下のいずれかの認証方法を選択します："]}]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["Account Key認証方法"," ","Shared Access Signatures認証方法"," ","Proxy Setting (オプション)"," ","On Premises Setting (オプション)"]},{"$$mdtype":"Tag","name":"ol","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":["Authentication Modeドロップダウンメニューから",{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Shared Access Signature"]},"を選択します。"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":["ストレージの",{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Account Name"]},"を入力します。"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":["Azure Portalからコピーした",{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Account Key"]},"を入力します。"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":["Authentication Modeドロップダウンメニューから",{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Shared Access Signature"]},"を選択します。"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":["ストレージの",{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Account Name"]},"を入力します。"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":["Azure Portalからコピーした",{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Account Key"]},"を入力します。"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":["HTTP Proxyを経由して実行する場合は、Proxy Typeを選択します。"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Proxy Host"]},"、",{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Proxy Port"]},"、",{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Proxy Username"]},"、",{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Proxy Password"]},"を入力します。"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":["Data Lakeがオンプレミスにある場合は、On Premises Settingを指定します。"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":["Premises Hostを入力します。"," ","On Premises Settingでは、Shared Access Signatures認証方式のみがサポートされています。"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":["接続の名前を入力します。"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":["認証を他のユーザーと共有するかどうかを選択します。"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":["Continueを選択します。"]}]}]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":3,"id":"データをtreasure-dataに転送する","__idx":7},"children":["データをTreasure Dataに転送する"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["認証接続を作成すると、自動的にAuthenticationsページに移動します。"]},{"$$mdtype":"Tag","name":"ol","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":["作成した接続を検索します。"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["New Source"]},"を選択します。"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":["Data Transfer フィールドに",{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Source"]},"の名前を入力します**。**"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Next"]},"を選択します。Source Tableダイアログが開きます。"]}]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"img","attributes":{"src":"/assets/microsoft-azure-data-lake-storage-import-integration-2024-02-09.ee09ed7365f2ae06e3af338e48bcdd7edd953d3dc4da9b3347eafb96b2fc71db.be2392e9.png","alt":""},"children":[]}]},{"$$mdtype":"Tag","name":"ol","attributes":{"start":5},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":["以下のパラメータを編集します:"]}]},{"$$mdtype":"Tag","name":"div","attributes":{"className":"md-table-wrapper"},"children":[{"$$mdtype":"Tag","name":"table","attributes":{"className":"md"},"children":[{"$$mdtype":"Tag","name":"thead","attributes":{},"children":[{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"th","attributes":{"data-label":"Parameters"},"children":["Parameters"]},{"$$mdtype":"Tag","name":"th","attributes":{"data-label":"Description"},"children":["Description"]}]}]},{"$$mdtype":"Tag","name":"tbody","attributes":{},"children":[{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"td","attributes":{},"children":["Container"]},{"$$mdtype":"Tag","name":"td","attributes":{},"children":["Data Lakeのコンテナ名"]}]},{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"td","attributes":{},"children":["Path Prefix"]},{"$$mdtype":"Tag","name":"td","attributes":{},"children":["取り込むすべてのファイルを含むフォルダへのパス"]}]},{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"td","attributes":{},"children":["Path Match Pattern (optional)"]},{"$$mdtype":"Tag","name":"td","attributes":{},"children":["この正規表現パターンに一致するファイルのみをインポートします"]}]},{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"td","attributes":{},"children":["Sub folders are partitions"]},{"$$mdtype":"Tag","name":"td","attributes":{},"children":["Spark Partitionフォルダ構造を使用していることを指定する場合に有効にします。サブフォルダは<column_name>=valueの形式で名前を付ける必要があります"]}]},{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"td","attributes":{},"children":["Enable Schema Evolution"]},{"$$mdtype":"Tag","name":"td","attributes":{},"children":["parquet用のスキーマエボリューションを有効にします"]}]},{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"td","attributes":{},"children":["Incremental Loading"]},{"$$mdtype":"Tag","name":"td","attributes":{},"children":["インクリメンタルモードを有効にします。"]}]},{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"td","attributes":{},"children":["End time"]},{"$$mdtype":"Tag","name":"td","attributes":{},"children":["指定した時刻以降に変更されたファイルのみがインポートされます。"]}]},{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"td","attributes":{},"children":["Schema Settings"]},{"$$mdtype":"Tag","name":"td","attributes":{},"children":["「Sub Folders Are Partitions」が有効な場合、そのパーティションカラムのカラム名とデータ型を指定する必要があります"]}]},{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"td","attributes":{},"children":["Include Columns"]},{"$$mdtype":"Tag","name":"td","attributes":{},"children":["インポートするカラムを制限します。リストで指定されたカラムのみがインポートされます。リストが空の場合、すべてのカラムがインポートされます。"]}]}]}]}]},{"$$mdtype":"Tag","name":"ol","attributes":{"start":6},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":["Nextを選択します。"," ","Data Settingsページは必要に応じて変更できます。また、このページをスキップすることもできます。"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":["必要に応じて、以下のパラメータを編集します:"]}]}]},{"$$mdtype":"Tag","name":"div","attributes":{"className":"md-table-wrapper"},"children":[{"$$mdtype":"Tag","name":"table","attributes":{"className":"md"},"children":[{"$$mdtype":"Tag","name":"thead","attributes":{},"children":[{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"th","attributes":{"data-label":"Parameter"},"children":["Parameter"]},{"$$mdtype":"Tag","name":"th","attributes":{"data-label":"Description"},"children":["Description"]}]}]},{"$$mdtype":"Tag","name":"tbody","attributes":{},"children":[{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"td","attributes":{},"children":["---"]},{"$$mdtype":"Tag","name":"td","attributes":{},"children":["---"]}]},{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"td","attributes":{},"children":["Retry Limit"]},{"$$mdtype":"Tag","name":"td","attributes":{},"children":["最大リトライ回数"]}]},{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"td","attributes":{},"children":["Initial retry interval in millis"]},{"$$mdtype":"Tag","name":"td","attributes":{},"children":["初回リトライ間隔(ミリ秒)"]}]},{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"td","attributes":{},"children":["Max retry wait in millis"]},{"$$mdtype":"Tag","name":"td","attributes":{},"children":["最大リトライ間隔。初回リトライ後、待機間隔は最大値に達するまで2倍になります。"]}]},{"$$mdtype":"Tag","name":"tr","attributes":{},"children":[{"$$mdtype":"Tag","name":"td","attributes":{},"children":["repartition_number"]},{"$$mdtype":"Tag","name":"td","attributes":{},"children":["Out Of Memory例外を回避するために、入力ファイルを小さなファイルに分割します。大きなデータファイルに適用されます。デフォルト値は100です。"]}]}]}]}]},{"$$mdtype":"Tag","name":"ol","attributes":{"start":8},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Next"]},"を選択します。"]}]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":3,"id":"data-preview","__idx":8},"children":["Data Preview"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["Data Previewはこの統合ではサポートされていません。プレビューにはサンプルデータのみが表示されます。"]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":3,"id":"data-placement","__idx":9},"children":["Data Placement"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["データの配置について、データを配置したいターゲット database と table を選択し、インポートを実行する頻度を指定します。"]},{"$$mdtype":"Tag","name":"ol","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Next"]}," を選択します。Storage の下で、インポートされたデータを配置する新しい database を作成するか、既存の database を選択し、新しい table を作成するか、既存の table を選択します。"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Database"]}," を選択 > ",{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Select an existing"]}," または ",{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Create New Database"]}," を選択します。"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":["オプションで、database 名を入力します。"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Table"]}," を選択 > ",{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Select an existing"]}," または ",{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Create New Table"]}," を選択します。"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":["オプションで、table 名を入力します。"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":["データをインポートする方法を選択します。"]},{"$$mdtype":"Tag","name":"ul","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Append"]}," (デフォルト) - データインポートの結果は table に追加されます。"," ","table が存在しない場合は作成されます。"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Always Replace"]}," - 既存の table の全体の内容をクエリの結果出力で置き換えます。table が存在しない場合は、新しい table が作成されます。"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Replace on New Data"]}," - 新しいデータがある場合のみ、既存の table の全体の内容をクエリの結果出力で置き換えます。"]}]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Timestamp-based Partition Key"]}," 列を選択します。"," ","デフォルトキーとは異なるパーティションキーシードを設定したい場合は、long または timestamp 列をパーティショニング時刻として指定できます。デフォルトの時刻列として、add_time フィルターで upload_time を使用します。"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":["データストレージの ",{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Timezone"]}," を選択します。"]}]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Schedule"]}," の下で、このクエリを実行するタイミングと頻度を選択できます。"]}]}]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":4,"id":"一度だけ実行","__idx":10},"children":["一度だけ実行"]},{"$$mdtype":"Tag","name":"ol","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Off"]}," を選択します。"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Scheduling Timezone"]}," を選択します。"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Create & Run Now"]}," を選択します。"]}]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":4,"id":"定期的に繰り返す","__idx":11},"children":["定期的に繰り返す"]},{"$$mdtype":"Tag","name":"ol","attributes":{},"children":[{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["On"]}," を選択します。"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Schedule"]}," を選択します。UI では、",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["@hourly"]},"、",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["@daily"]},"、",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["@monthly"]},"、またはカスタム ",{"$$mdtype":"Tag","name":"em","attributes":{},"children":["cron"]}," の 4 つのオプションが提供されます。"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Delay Transfer"]}," を選択して、実行時間の遅延を追加することもできます。"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Scheduling Timezone"]}," を選択します。"]},{"$$mdtype":"Tag","name":"li","attributes":{},"children":[{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Create & Run Now"]}," を選択します。"]}]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["転送が実行された後、",{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Data Workbench"]}," > ",{"$$mdtype":"Tag","name":"strong","attributes":{},"children":["Databases"]}," で転送の結果を確認できます。"]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"workflowの設定オプション","__idx":12},"children":["Workflowの設定(オプション)"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["Treasure ワークフロー内で、ワークフロー内でこのデータコネクタの使用を指定できます。"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["詳細は",{"$$mdtype":"Tag","name":"MarkdownLink","attributes":{"href":"/tools/cli-and-sdks/api#workflow-commands"},"children":["Using Workflows to Export Data with the TD Toolbelt"]},"を参照してください。"]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":3,"id":"azure-data-lake-storage-input用のワークフロー例","__idx":13},"children":["Azure Data Lake Storage Input用のワークフロー例"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"data-language":"yaml","header":{"controls":{"copy":{}}},"source":"+setup:\n  echo>: start ${session_time}\n\n+import-with-sql:\n  td_load>: config.yml\n  database: ${td.some_database}\n  table: ${td.some_table2}\n\n+teardown:\n  echo>: finish ${session_time}\n\n","lang":"yaml"},"children":[]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":3,"id":"例configyml","__idx":14},"children":["例(config.yml)"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["以下は、Azure Data Lakeからファイルを取得するための設定ファイルの例です:"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"header":{"controls":{"copy":{}}},"source":"input:    type: azure_datalake  authentication_mode: account_key  account_name: tdadl  account_key: fjZliu61iZV  sas_token: ?sv=sas_token  container_name: test  path_prefix:  /traffic_data/partition/collisionrecords2/  path_match_pattern: /traffic_data/partition/collisionrecords2/*  subfolder_partitions: true  proxy_type: none  proxy_host: host  proxy_port: 3128  proxy_username: tdpy  proxy_password: 321tre  repartition_number: 100  schema_evolution: false  incremental: true  last_updated_at: \"2023-12-20T03:51:20.937Z\"  include_columns: [          col0,          col3,          col4,      ]\n"},"children":[]},{"$$mdtype":"Tag","name":"Heading","attributes":{"level":2,"id":"blobのソフト削除を有効にする","__idx":15},"children":["Blobのソフト削除を有効にする"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["`\"Soft delete for blobs\"機能を有効にすると、コネクタはREST APIを使用するため動作しません。"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["この機能を使用するには、Azure Portalにログインし、概要ページからData Lake StorageのPropertiesを変更して、\"Hierarchical namespace\"を有効にします。"]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":["エラー例は次のようになります。"]},{"$$mdtype":"Tag","name":"CodeBlock","attributes":{"header":{"controls":{"copy":{}}},"source":"Caused by: org.apache.hadoop.fs.azurebfs.contracts.exceptions.AbfsRestOperationException: Operation failed: \"Server failed to authenticate the request. Make sure the value of Authorization header is formed correctly including the signature.\", 403, HEAD, https://kfcusprdanalyticsadl.dfs.core.windows.net/data-science-container/?upn=false&action=getAccessControl&timeout=90&sp=racwdlmep&st=2024-08-26T15:03:55Z&se=2024-10-15T23:03:55Z&spr=https&sv=2022-11-02&sr=d&sig=XXXXX&sdd=2s, rId: 596f51a1-601f-000d-6fe0-f7dd2e000000\n"},"children":[]},{"$$mdtype":"Tag","name":"p","attributes":{},"children":[{"$$mdtype":"Tag","name":"img","attributes":{"src":"/assets/microsoft-azure-data-lake-storage-import-integration-2024-01-22-1.b750ccc25eaedbfedd0afde60be2d202068ada00dd83d08a52c7624981a7b4d2.be2392e9.png","alt":""},"children":[]}]}]},"headings":[{"value":"Microsoft Azure Data Lake Storage Import Integration","id":"microsoft-azure-data-lake-storage-import-integration","depth":1},{"value":"この統合で何ができるか？","id":"この統合で何ができるか","depth":2},{"value":"前提条件","id":"前提条件","depth":2},{"value":"制限事項","id":"制限事項","depth":2},{"value":"Microsoft Azure PortalからAccess KeyまたはShared Access Signatureを取得する","id":"microsoft-azure-portalからaccess-keyまたはshared-access-signatureを取得する","depth":2},{"value":"Treasure コンソールを使用して接続を作成する","id":"treasure-コンソールを使用して接続を作成する","depth":2},{"value":"新しい接続を作成する","id":"新しい接続を作成する","depth":3},{"value":"データをTreasure Dataに転送する","id":"データをtreasure-dataに転送する","depth":3},{"value":"Data Preview","id":"data-preview","depth":3},{"value":"Data Placement","id":"data-placement","depth":3},{"value":"一度だけ実行","id":"一度だけ実行","depth":4},{"value":"定期的に繰り返す","id":"定期的に繰り返す","depth":4},{"value":"Workflowの設定(オプション)","id":"workflowの設定オプション","depth":2},{"value":"Azure Data Lake Storage Input用のワークフロー例","id":"azure-data-lake-storage-input用のワークフロー例","depth":3},{"value":"例(config.yml)","id":"例configyml","depth":3},{"value":"Blobのソフト削除を有効にする","id":"blobのソフト削除を有効にする","depth":2}],"frontmatter":{"seo":{"title":"Microsoft Azure Data Lake Storage Import Integration"}},"lastModified":"2026-06-01T09:47:58.000Z","pagePropGetterError":{"message":"","name":""}},"slug":"/ja/int/microsoft-azure-data-lake-storage-import-integration","userData":{"isAuthenticated":false,"teams":["anonymous"]},"isPublic":true}