[Feature][Connector-V2][Iceberg] Support Iceberg Kerberos by luzongzhu · Pull Request #7246 · apache/seatunnel

luzongzhu · 2024-07-22T13:06:40Z

Purpose of this pull request

Does this PR introduce any user-facing change?

How was this patch tested?

Check list

If any new Jar binary package adding in your PR, please add License Notice according
New License Guide
If necessary, please update the documentation to describe the new feature. https://github.com/apache/seatunnel/tree/dev/docs
If you are contributing the connector code, please check that the following files are updated:
1. Update change log that in connector document. For more details you can refer to connector-v2
2. Update plugin-mapping.properties and add new connector information in it
3. Update the pom file of seatunnel-dist
Update the release-note.

Hisoka-X · 2024-07-30T07:04:45Z

cc @hailin0 @EricJoy2048

Hisoka-X · 2024-08-07T07:45:42Z

Can we extend a kerberos test on our iceberg e2e?

luzongzhu · 2024-08-08T11:48:24Z

Can we extend a kerberos test on our iceberg e2e?

[LOG-PATH]: /opt/dolphinscheduler/logs/20240801/13920631639648_98-319758-319902.log, [HOST]:  Host{address='xxxxxx:1234', ip='xxxxxx', port=1234}
[INFO] 2024-08-01 19:15:05.170 +0800 - Begin to pulling task
[INFO] 2024-08-01 19:15:05.179 +0800 - Begin to initialize task
[INFO] 2024-08-01 19:15:05.179 +0800 - Set task startTime: Thu Aug 01 19:15:05 CST 2024
[INFO] 2024-08-01 19:15:05.181 +0800 - Set task envFile: /opt/dolphinscheduler/conf/dolphinscheduler_env.sh
[INFO] 2024-08-01 19:15:05.182 +0800 - Set task appId: 319758_319902
[INFO] 2024-08-01 19:15:05.182 +0800 - End initialize task
[INFO] 2024-08-01 19:15:05.210 +0800 - Set task status to TaskExecutionStatus{code=1, desc='running'}
[INFO] 2024-08-01 19:15:05.285 +0800 - TenantCode:admin check success
[INFO] 2024-08-01 19:15:05.289 +0800 - ProcessExecDir:/tmp/dolphinscheduler/exec/process/admin/10633993590912/13920631639648_98/319758/319902 check success
[INFO] 2024-08-01 19:15:05.289 +0800 - Resources:{} check success
[INFO] 2024-08-01 19:15:05.632 +0800 - Task plugin: DATAINTEGRATION create success
[INFO] 2024-08-01 19:15:07.681 +0800 - Success initialized task plugin instance success
[INFO] 2024-08-01 19:15:07.681 +0800 - Success set taskVarPool: null
[INFO] 2024-08-01 19:15:07.926 +0800 - tenantCode :admin, task dir:/tmp/dolphinscheduler/exec/process/admin/10633993590912/13920631639648_98/319758/319902
[INFO] 2024-08-01 19:15:07.927 +0800 - generate script file:/tmp/dolphinscheduler/exec/process/admin/10633993590912/13920631639648_98/319758/319902/seatunnel_319758_319902.conf
[INFO] 2024-08-01 19:15:07.957 +0800 - SeaTunnel task command: ${SEATUNNEL_HOME}/bin/seatunnel.sh --config /tmp/dolphinscheduler/exec/process/admin/10633993590912/13920631639648_98/319758/319902/seatunnel_319758_319902.conf
[INFO] 2024-08-01 19:15:07.957 +0800 - log path /opt/dolphinscheduler/logs/20240801/13920631639648_98-319758-319902.log,task log name taskAppId=TASK-20240801-13920631639648_98-319758-319902
[INFO] 2024-08-01 19:15:07.959 +0800 - Begin to create command file:/tmp/dolphinscheduler/exec/process/admin/10633993590912/13920631639648_98/319758/319902/319758_319902.command
[INFO] 2024-08-01 19:15:07.961 +0800 - Success create command file, command: #!/bin/bash
BASEDIR=$(cd `dirname $0`; pwd)
cd $BASEDIR
source /opt/dolphinscheduler/conf/dolphinscheduler_env.sh
${SEATUNNEL_HOME}/bin/seatunnel.sh --config /tmp/dolphinscheduler/exec/process/admin/10633993590912/13920631639648_98/319758/319902/seatunnel_319758_319902.conf
[INFO] 2024-08-01 19:15:07.973 +0800 - task run command: sudo -u admin -E bash /tmp/dolphinscheduler/exec/process/admin/10633993590912/13920631639648_98/319758/319902/319758_319902.command
[INFO] 2024-08-01 19:15:07.977 +0800 - process start, process id is: 141
[INFO] 2024-08-01 19:15:08.980 +0800 -  -> Aug 01, 2024 7:15:08 PM com.hazelcast.internal.config.AbstractConfigLocator
	INFO: Loading configuration '/opt/soft/seatunnel/config/seatunnel.yaml' from System property 'seatunnel.config'
	Aug 01, 2024 7:15:08 PM com.hazelcast.internal.config.AbstractConfigLocator
	INFO: Using configuration file at /opt/soft/seatunnel/config/seatunnel.yaml
	Aug 01, 2024 7:15:08 PM org.apache.seatunnel.engine.common.config.SeaTunnelConfig
	INFO: seatunnel.home is /tmp/dolphinscheduler/exec/process/admin/10633993590912/13920631639648_98/319758/319902
[INFO] 2024-08-01 19:15:09.982 +0800 -  -> Aug 01, 2024 7:15:09 PM com.hazelcast.internal.config.AbstractConfigLocator
	INFO: Loading configuration '/opt/soft/seatunnel/config/hazelcast.yaml' from System property 'hazelcast.config'
	Aug 01, 2024 7:15:09 PM com.hazelcast.internal.config.AbstractConfigLocator
	INFO: Using configuration file at /opt/soft/seatunnel/config/hazelcast.yaml
	Aug 01, 2024 7:15:09 PM com.hazelcast.internal.config.AbstractConfigLocator
	INFO: Loading configuration '/opt/soft/seatunnel/config/hazelcast-client.yaml' from System property 'hazelcast.client.config'
	Aug 01, 2024 7:15:09 PM com.hazelcast.internal.config.AbstractConfigLocator
	INFO: Using configuration file at /opt/soft/seatunnel/config/hazelcast-client.yaml
	2024-08-01 19:15:09,951 INFO  [.c.i.s.ClientInvocationService] [main] - hz.client_1 [seatunnel] [5.1] Running with 2 response threads, dynamic=true
[INFO] 2024-08-01 19:15:10.989 +0800 -  -> 2024-08-01 19:15:10,043 INFO  [c.h.c.LifecycleService        ] [main] - hz.client_1 [seatunnel] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is STARTING
	2024-08-01 19:15:10,044 INFO  [c.h.c.LifecycleService        ] [main] - hz.client_1 [seatunnel] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is STARTED
	2024-08-01 19:15:10,087 INFO  [.c.i.c.ClientConnectionManager] [main] - hz.client_1 [seatunnel] [5.1] Trying to connect to cluster: seatunnel
	2024-08-01 19:15:10,092 INFO  [.c.i.c.ClientConnectionManager] [main] - hz.client_1 [seatunnel] [5.1] Trying to connect to [10.109.xx.xx]:5801
	2024-08-01 19:15:10,201 INFO  [c.h.c.LifecycleService        ] [main] - hz.client_1 [seatunnel] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is CLIENT_CONNECTED
	2024-08-01 19:15:10,201 INFO  [.c.i.c.ClientConnectionManager] [main] - hz.client_1 [seatunnel] [5.1] Authenticated with server [10.109.xx.xx]:5801:f85e791b-bcb5-45b0-a754-f7855e2b343b, server version: 5.1, local address: /xxxxxx:3105
	2024-08-01 19:15:10,203 INFO  [c.h.i.d.Diagnostics           ] [main] - hz.client_1 [seatunnel] [5.1] Diagnostics disabled. To enable add -Dhazelcast.diagnostics.enabled=true to the JVM arguments.
	2024-08-01 19:15:10,253 INFO  [c.h.c.i.s.ClientClusterService] [hz.client_1.event-3] - hz.client_1 [seatunnel] [5.1] 
	
	Members [1] {
		Member [10.109.xx.xx]:5801 - f85e791b-bcb5-45b0-a754-f7855e2b343b
	}
	
	2024-08-01 19:15:10,325 INFO  [.c.i.s.ClientStatisticsService] [main] - Client statistics is enabled with period 5 seconds.
	2024-08-01 19:15:10,579 INFO  [.ClientJobExecutionEnvironment] [main] - add common jar in plugins :[]
	2024-08-01 19:15:10,664 INFO  [o.a.s.c.s.u.ConfigBuilder     ] [main] - Loading config file from path: /tmp/dolphinscheduler/exec/process/admin/10633993590912/13920631639648_98/319758/319902/seatunnel_319758_319902.conf
	2024-08-01 19:15:10,718 INFO  [o.a.s.c.s.u.ConfigShadeUtils  ] [main] - Load config shade spi: [base64]
	2024-08-01 19:15:10,839 INFO  [o.a.s.c.s.u.ConfigBuilder     ] [main] - Parsed config file: 
	{
	    "env" : {
	        "job.name" : "1818968701584089089",
	        "job.mode" : "BATCH",
	        "execution.parallelism" : 1,
	        "shade.identifier" : "base64"
	    },
	    "source" : [
	        {
	            "password" : "123456",
	            "driver" : "org.postgresql.Driver",
	            "query" : "SELECT mandt,matnr,spras,maktx,maktg FROM bi_source.makt_kafka_source",
	            "result_table_name" : "ST_GLOBAL_VIEW_NAME",
	            "plugin_name" : "Jdbc",
	            "user" : "postgres",
	            "url" : "jdbc:postgresql://xxxxxx:5432/test"
	        }
	    ],
	    "transform" : [
	        {
	            "query" : "SELECT mandt as mandt,matnr as matnr,spras as spras,maktx as maktx,maktg as maktg,TO_DATE('2024-08-01 19:15:05', 'yyyy-MM-dd HH:mm:ss') as fdop_import_time FROM ST_GLOBAL_VIEW_NAME",
	            "source_table_name" : "ST_GLOBAL_VIEW_NAME",
	            "result_table_name" : "ST_GLOBAL_VIEW_NAME",
	            "plugin_name" : "Sql"
	        }
	    ],
	    "sink" : [
	        {
	            "catalog_name" : "iceberg",
	            "iceberg.table.write-props" : {
	                "write.format.default" : "parquet",
	                "write.target-file-size-bytes" : "536870912"
	            },
	            "iceberg.catalog.config" : {
	                "type" : "hive",
	                "uri" : "thrift://hdp002.test.io:9083",
	                "warehouse" : "hdfs://hdp002.test.io:8020/warehouse/tablespace/managed/hive"
	            },
	            "kerberos_principal" : "hive/hdp002.test.io@test.IO",
	            "case_sensitive" : true,
	            "namespace" : "tst",
	            "source_table_name" : "ST_GLOBAL_VIEW_NAME",
	            "kerberos_krb5_conf_path" : "/data/test/hdp/krb5.conf",
	            "plugin_name" : "Iceberg",
	            "iceberg.hadoop-conf-path" : "/data/test/hdp",
	            "kerberos_keytab_path" : "/data/test/hdp/hive.service.keytab",
	            "table" : "ods_makt_kafka_iceberg"
	        }
	    ]
	}
	
	2024-08-01 19:15:10,863 INFO  [.s.p.d.AbstractPluginDiscovery] [main] - Load SeaTunnelSink Plugin from /opt/soft/seatunnel/connectors
	2024-08-01 19:15:10,883 INFO  [.s.p.d.AbstractPluginDiscovery] [main] - Discovery plugin jar for: PluginIdentifier{engineType='seatunnel', pluginType='source', pluginName='Jdbc'} at: file:/opt/soft/seatunnel/connectors/connector-jdbc-2.3.5.jar
	2024-08-01 19:15:10,885 INFO  [.s.p.d.AbstractPluginDiscovery] [main] - Discovery plugin jar for: PluginIdentifier{engineType='seatunnel', pluginType='sink', pluginName='Iceberg'} at: file:/opt/soft/seatunnel/connectors/connector-iceberg-2.3.5.jar
	2024-08-01 19:15:10,889 WARN  [o.a.s.a.c.u.ConfigUtil        ] [main] - Option 'source_table_name' is a List, and it is recommended to configure it as ["string1","string2"]; we will only use ',' to split the String into a list.
	2024-08-01 19:15:10,889 WARN  [o.a.s.a.c.u.ConfigUtil        ] [main] - Option 'source_table_name' is a List, and it is recommended to configure it as ["string1","string2"]; we will only use ',' to split the String into a list.
	2024-08-01 19:15:10,895 INFO  [p.MultipleTableJobConfigParser] [main] - start generating all sources.
	2024-08-01 19:15:10,971 INFO  [o.a.s.c.s.j.u.JdbcCatalogUtils] [main] - Loading catalog tables for catalog : class org.apache.seatunnel.connectors.seatunnel.jdbc.catalog.psql.PostgresCatalog
[INFO] 2024-08-01 19:15:11.990 +0800 -  -> SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
	SLF4J: Defaulting to no-operation (NOP) logger implementation
	SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
	2024-08-01 19:15:11,456 INFO  [.s.c.s.j.c.AbstractJdbcCatalog] [main] - Catalog Postgres established connection to jdbc:postgresql://xxxxxx:5432/test
	2024-08-01 19:15:11,498 INFO  [o.a.s.c.s.j.u.JdbcCatalogUtils] [main] - Loaded catalog table : default.default.default, JdbcSourceTable(tablePath=default.default.default, query=SELECT mandt,matnr,spras,maktx,maktg FROM bi_source.makt_kafka_source, partitionColumn=null, partitionNumber=10, partitionStart=null, partitionEnd=null, catalogTable=CatalogTable{tableId=jdbc_catalog.default.default.default, tableSchema=TableSchema(columns=[PhysicalColumn(super=Column(name=mandt, dataType=STRING, columnLength=12, scale=null, nullable=false, defaultValue=null, comment=null, sourceType=varchar(3), options=null, isUnsigned=false, isZeroFill=false, bitLen=96, longColumnLength=12)), PhysicalColumn(super=Column(name=matnr, dataType=STRING, columnLength=160, scale=null, nullable=false, defaultValue=null, comment=null, sourceType=varchar(40), options=null, isUnsigned=false, isZeroFill=false, bitLen=1280, longColumnLength=160)), PhysicalColumn(super=Column(name=spras, dataType=STRING, columnLength=4, scale=null, nullable=false, defaultValue=null, comment=null, sourceType=varchar(1), options=null, isUnsigned=false, isZeroFill=false, bitLen=32, longColumnLength=4)), PhysicalColumn(super=Column(name=maktx, dataType=STRING, columnLength=160, scale=null, nullable=true, defaultValue=null, comment=null, sourceType=varchar(40), options=null, isUnsigned=false, isZeroFill=false, bitLen=1280, longColumnLength=160)), PhysicalColumn(super=Column(name=maktg, dataType=STRING, columnLength=160, scale=null, nullable=true, defaultValue=null, comment=null, sourceType=varchar(40), options=null, isUnsigned=false, isZeroFill=false, bitLen=1280, longColumnLength=160))], primaryKey=null, constraintKeys=[]), options={}, partitionKeys=[], comment='', catalogName='jdbc_catalog'})
	2024-08-01 19:15:11,498 INFO  [o.a.s.c.s.j.u.JdbcCatalogUtils] [main] - Loaded 1 catalog tables for catalog : class org.apache.seatunnel.connectors.seatunnel.jdbc.catalog.psql.PostgresCatalog
	2024-08-01 19:15:11,499 INFO  [.s.c.s.j.c.AbstractJdbcCatalog] [main] - Catalog Postgres closing
	2024-08-01 19:15:11,500 INFO  [o.a.s.a.t.f.FactoryUtil       ] [main] - get the CatalogTable from source Jdbc: jdbc_catalog.default.default.default
	2024-08-01 19:15:11,512 INFO  [.s.p.d.AbstractPluginDiscovery] [main] - Load SeaTunnelSource Plugin from /opt/soft/seatunnel/connectors
	2024-08-01 19:15:11,517 INFO  [.s.p.d.AbstractPluginDiscovery] [main] - Discovery plugin jar for: PluginIdentifier{engineType='seatunnel', pluginType='source', pluginName='Jdbc'} at: file:/opt/soft/seatunnel/connectors/connector-jdbc-2.3.5.jar
	2024-08-01 19:15:11,519 INFO  [p.MultipleTableJobConfigParser] [main] - start generating all transforms.
	2024-08-01 19:15:11,522 INFO  [.s.p.d.AbstractPluginDiscovery] [main] - Load SeaTunnelTransform Plugin from /opt/soft/seatunnel/lib
	2024-08-01 19:15:11,522 WARN  [o.a.s.a.c.u.ConfigUtil        ] [main] - Option 'source_table_name' is a List, and it is recommended to configure it as ["string1","string2"]; we will only use ',' to split the String into a list.
	2024-08-01 19:15:11,529 WARN  [o.a.s.a.c.u.ConfigUtil        ] [main] - Option 'source_table_name' is a List, and it is recommended to configure it as ["string1","string2"]; we will only use ',' to split the String into a list.
	2024-08-01 19:15:11,599 INFO  [p.MultipleTableJobConfigParser] [main] - start generating all sinks.
	2024-08-01 19:15:11,600 WARN  [o.a.s.a.c.u.ConfigUtil        ] [main] - Option 'source_table_name' is a List, and it is recommended to configure it as ["string1","string2"]; we will only use ',' to split the String into a list.
	2024-08-01 19:15:11,602 INFO  [.s.p.d.AbstractPluginDiscovery] [main] - Load SeaTunnelSink Plugin from /opt/soft/seatunnel/connectors
	2024-08-01 19:15:11,603 INFO  [.s.p.d.AbstractPluginDiscovery] [main] - Discovery plugin jar for: PluginIdentifier{engineType='seatunnel', pluginType='sink', pluginName='Iceberg'} at: file:/opt/soft/seatunnel/connectors/connector-iceberg-2.3.5.jar
	2024-08-01 19:15:11,872 WARN  [o.a.h.u.NativeCodeLoader      ] [main] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
	2024-08-01 19:15:11,925 INFO  [a.s.c.s.i.IcebergCatalogLoader] [main] - Start Kerberos authentication using principal hive/hdp002.test.io@test.IO and keytab /data/test/hdp/hive.service.keytab
[INFO] 2024-08-01 19:15:12.991 +0800 -  -> 2024-08-01 19:15:12,015 INFO  [o.a.h.s.UserGroupInformation  ] [main] - Login successful for user hive/hdp002.test.io@test.IO using keytab file /data/test/hdp/hive.service.keytab
	2024-08-01 19:15:12,016 INFO  [a.s.c.s.i.IcebergCatalogLoader] [main] - Kerberos authentication successful,UGIhive/hdp002.test.io@test.IO (auth:KERBEROS)
	2024-08-01 19:15:12,016 INFO  [a.s.c.s.i.IcebergCatalogLoader] [main] - Hadoop config initialized: org.apache.hadoop.hdfs.HdfsConfiguration
	2024-08-01 19:15:12,184 INFO  [a.s.a.s.SaveModeExecuteWrapper] [main] - Executing save mode for table: tst.default.ods_makt_kafka_iceberg, with SchemaSaveMode: CREATE_SCHEMA_WHEN_NOT_EXIST, DataSaveMode: APPEND_DATA using Catalog: Iceberg
	2024-08-01 19:15:12,217 INFO  [o.a.h.h.c.HiveConf            ] [main] - Found configuration file null
	2024-08-01 19:15:12,422 WARN  [o.a.h.h.c.HiveConf            ] [main] - HiveConf of name hive.hook.proto.base-directory does not exist
	2024-08-01 19:15:12,423 WARN  [o.a.h.h.c.HiveConf            ] [main] - HiveConf of name hive.strict.managed.tables does not exist
	2024-08-01 19:15:12,423 WARN  [o.a.h.h.c.HiveConf            ] [main] - HiveConf of name hive.stats.fetch.partition.stats does not exist
	2024-08-01 19:15:12,424 WARN  [o.a.h.h.c.HiveConf            ] [main] - HiveConf of name hive.heapsize does not exist
	2024-08-01 19:15:12,480 INFO  [o.a.h.h.m.HiveMetaStoreClient ] [main] - Trying to connect to metastore with URI thrift://hdp002.test.io:9083
	2024-08-01 19:15:12,488 INFO  [o.a.h.h.m.HiveMetaStoreClient ] [main] - HMSC::open(): Could not find delegation token. Creating KERBEROS-based thrift connection.
	2024-08-01 19:15:12,696 INFO  [o.a.h.h.m.HiveMetaStoreClient ] [main] - Opened a connection to metastore, current connections: 1
	2024-08-01 19:15:12,697 INFO  [o.a.h.h.m.HiveMetaStoreClient ] [main] - Connected to metastore.
	2024-08-01 19:15:12,697 INFO  [.h.h.m.RetryingMetaStoreClient] [main] - RetryingMetaStoreClient proxy=class org.apache.hadoop.hive.metastore.HiveMetaStoreClient ugi=hive/hdp002.test.io@test.IO (auth:KERBEROS) retries=24 delay=5 lifetime=0
[INFO] 2024-08-01 19:15:13.992 +0800 -  -> 2024-08-01 19:15:12,999 INFO  [i.BaseMetastoreTableOperations] [main] - Refreshing table metadata from new version: hdfs://ns1/warehouse/tablespace/managed/hive/tst.db/ods_makt_kafka_iceberg/metadata/00000-0e52a973-aa2d-4542-8878-7c00c89a83f7.metadata.json
	2024-08-01 19:15:13,371 WARN  [o.a.h.h.s.DomainSocketFactory ] [main] - The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.
[INFO] 2024-08-01 19:15:14.993 +0800 -  -> 2024-08-01 19:15:14,148 INFO  [o.a.i.BaseMetastoreCatalog    ] [main] - Table loaded by catalog: iceberg.tst.ods_makt_kafka_iceberg
	2024-08-01 19:15:14,206 INFO  [o.a.s.e.c.j.ClientJobProxy    ] [main] - Start submit job, job id: 871350342623690753, with plugin jar [file:/opt/soft/seatunnel/connectors/connector-jdbc-2.3.5.jar, file:/opt/soft/seatunnel/connectors/connector-iceberg-2.3.5.jar]
	2024-08-01 19:15:14,728 INFO  [o.a.s.e.c.j.ClientJobProxy    ] [main] - Submit job finished, job id: 871350342623690753, job name: 1818968701584089089
	2024-08-01 19:15:14,809 WARN  [o.a.s.e.c.j.JobMetricsRunner  ] [job-metrics-runner-871350342623690753] - Failed to get job metrics summary, it maybe first-run
[INFO] 2024-08-01 19:15:18.994 +0800 -  -> 2024-08-01 19:15:18,949 INFO  [o.a.s.e.c.j.ClientJobProxy    ] [main] - Job (871350342623690753) end with state FINISHED
[INFO] 2024-08-01 19:15:19.104 +0800 - process has exited. execute path:/tmp/dolphinscheduler/exec/process/admin/10633993590912/13920631639648_98/319758/319902, processId:141 ,exitStatusCode:0 ,processWaitForStatus:true ,processExitValue:0
[INFO] 2024-08-01 19:15:19.108 +0800 - Send task execute result to master, the current task status: TaskExecutionStatus{code=7, desc='success'}
[INFO] 2024-08-01 19:15:19.109 +0800 - Remove the current task execute context from worker cache
[INFO] 2024-08-01 19:15:19.109 +0800 - The current execute mode isn't develop mode, will clear the task execute file: /tmp/dolphinscheduler/exec/process/admin/10633993590912/13920631639648_98/319758/319902
[INFO] 2024-08-01 19:15:19.119 +0800 - Success clear the task execute file: /tmp/dolphinscheduler/exec/process/admin/10633993590912/13920631639648_98/319758/319902
[INFO] 2024-08-01 19:15:19.995 +0800 -  -> 2024-08-01 19:15:19,021 INFO  [s.c.s.s.c.ClientExecuteCommand] [main] - 
	***********************************************
	           Job Statistic Information
	***********************************************
	Start Time                : 2024-08-01 19:15:10
	End Time                  : 2024-08-01 19:15:18
	Total Time(s)             :                   8
	Total Read Count          :                 179
	Total Write Count         :                 179
	Total Failed Count        :                   0
	***********************************************
	
	2024-08-01 19:15:19,021 INFO  [c.h.c.LifecycleService        ] [main] - hz.client_1 [seatunnel] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is SHUTTING_DOWN
	2024-08-01 19:15:19,055 INFO  [.c.i.c.ClientConnectionManager] [main] - hz.client_1 [seatunnel] [5.1] Removed connection to endpoint: [10.109.xx.xx]:5801:f85e791b-bcb5-45b0-a754-f7855e2b343b, connection: ClientConnection{alive=false, connectionId=1, channel=NioChannel{/xxxxxx:3105->/10.109.xx.xx:5801}, remoteAddress=[10.109.xx.xx]:5801, lastReadTime=2024-08-01 19:15:18.998, lastWriteTime=2024-08-01 19:15:18.949, closedTime=2024-08-01 19:15:19.025, connected server version=5.1}
	2024-08-01 19:15:19,055 INFO  [c.h.c.LifecycleService        ] [main] - hz.client_1 [seatunnel] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is CLIENT_DISCONNECTED
	2024-08-01 19:15:19,058 INFO  [c.h.c.LifecycleService        ] [main] - hz.client_1 [seatunnel] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is SHUTDOWN
	2024-08-01 19:15:19,058 INFO  [s.c.s.s.c.ClientExecuteCommand] [main] - Closed SeaTunnel client......
	2024-08-01 19:15:19,058 INFO  [s.c.s.s.c.ClientExecuteCommand] [main] - Closed metrics executor service ......
	2024-08-01 19:15:19,060 INFO  [s.c.s.s.c.ClientExecuteCommand] [ForkJoinPool.commonPool-worker-1] - run shutdown hook because get close signal
[INFO] 2024-08-01 19:15:19.997 +0800 - FINALIZE_SESSION

Hisoka-X

LGTM if ci passed. Thanks @luzongzhu !

github-actions Bot added connectors-v2 api labels Jul 22, 2024

luzongzhu mentioned this pull request Jul 22, 2024

[Feature][Connector-V2][Iceberg] Support Iceberg Kerberos #7244

Closed

3 tasks

luzongzhu added 2 commits July 22, 2024 21:18

[Feature][Connector-V2][Iceberg] Support Iceberg Kerberos

696a928

[Feature][Connector-V2][Iceberg] Support Iceberg Kerberos

0bbe7a7

luzongzhu force-pushed the dev branch from 37a8350 to 0bbe7a7 Compare July 22, 2024 13:18

luzongzhu added 4 commits July 22, 2024 22:46

[Feature][Connector-V2][Iceberg] Support Iceberg Kerberos

8594af6

fix spotless:check

253fff9

fix connector-iceberg spotless:check

8ad0d55

fix connector-iceberg run test error

4135c8a

Hisoka-X added the First-time contributor First-time contributor label Jul 23, 2024

Hisoka-X reviewed Jul 23, 2024

View reviewed changes

Comment thread seatunnel-common/src/main/java/org/apache/seatunnel/common/exception/CommonErrorCode.java Outdated

Comment thread .../src/main/java/org/apache/seatunnel/connectors/seatunnel/iceberg/data/IcebergTypeMapper.java Outdated

luzongzhu and others added 4 commits July 24, 2024 09:32

Merge branch 'apache:dev' into dev

9c8b90c

Merge branch 'apache:dev' into dev

0307cc4

Resolve conversation

7ddcf1e

Merge branch 'apache:dev' into dev

5ed486f

Merge branch 'dev' into dev

302b1df

Hisoka-X reviewed Aug 8, 2024

View reviewed changes

Comment thread ...erg/src/main/java/org/apache/seatunnel/connectors/seatunnel/iceberg/config/CommonConfig.java Outdated

abstract kerberos config into a public configuration class

ef9e62d

github-actions Bot removed the iceberg label Aug 13, 2024

Hisoka-X approved these changes Aug 13, 2024

View reviewed changes

github-actions Bot added approved reviewed labels Aug 13, 2024

hailin0 approved these changes Aug 14, 2024

View reviewed changes

hailin0 merged commit e300120 into apache:dev Aug 14, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[Feature][Connector-V2][Iceberg] Support Iceberg Kerberos#7246

[Feature][Connector-V2][Iceberg] Support Iceberg Kerberos#7246
hailin0 merged 12 commits into
apache:devfrom
luzongzhu:dev

luzongzhu commented Jul 22, 2024

Uh oh!

Uh oh!

Uh oh!

Hisoka-X commented Jul 30, 2024

Uh oh!

Hisoka-X commented Aug 7, 2024

Uh oh!

luzongzhu commented Aug 8, 2024

Uh oh!

Uh oh!

Hisoka-X left a comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

luzongzhu commented Jul 22, 2024

Purpose of this pull request

Does this PR introduce any user-facing change?

How was this patch tested?

Check list

Uh oh!

Uh oh!

Uh oh!

Hisoka-X commented Jul 30, 2024

Uh oh!

Hisoka-X commented Aug 7, 2024

Uh oh!

luzongzhu commented Aug 8, 2024

Uh oh!

Uh oh!

Hisoka-X left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants