[Feature][Transforms-V2] Handling LLM non-standard format responses

[spitfireuptown]

Purpose of this pull request

Does this PR introduce any user-facing change?

How was this patch tested?

Check list

• If any new Jar binary package adding in your PR, please add License Notice according
  New License Guide
• If necessary, please update the documentation to describe the new feature. https://github.com/apache/seatunnel/tree/dev/docs
• If you are contributing the connector code, please check that the following files are updated:
  1. Update plugin-mapping.properties and add new connector information in it
  2. Update the pom file of seatunnel-dist
  3. Add ci label in label-scope-conf
  4. Add e2e testcase in seatunnel-e2e
  5. Update connector plugin_config
• Update the release-note.

[davidzollo]

Good job, please solve the ci error as follows:

https://github.com/apache/seatunnel/pull/8551/checks?check_run_id=35781798828

Unable to detect the workflow run for testing the changes in your PR.

If you did not enable GitHub Actions in your forked repository, please enable it by clicking the button as shown in the image below. See also Disabling or limiting GitHub Actions for a repository for more details.
Create and push an empty commit to trigger the workflow.
It is possible your branch is based on the old dev branch in Apache SeaTunnel, please sync your branch to the latest dev branch. For example as below:

git fetch upstream
git rebase upstream/dev
git push origin YOUR_BRANCH --force

Please contact me if you meet any problem, my Linkedin(https://www.linkedin.com/in/davidzollo) or WeChat(davidzollo), please tell me your github id when added.

[Hisoka-X]

Could you add a test case for this? Thanks

[spitfireuptown]

Could you add a test case for this? Thanks

ok, this is my first time to submit an open source project pr. please forgive me

[corgy-w]

Is it possible to specify the error here？
eg：
try { return OBJECT_MAPPER.convertValue( parseResponse(responseStr), new TypeReference<List<String>>() {}); } catch (IllegalArgumentException or xxxx e) { try { String result = OBJECT_MAPPER.convertValue( parseResponse(responseStr), new TypeReference<String>() {}); return Collections.singletonList(result); } catch (Exception ex) { xxxxx } }

[spitfireuptown]

that better,but origin code were not handling exception here

[corgy-w]

get

[spitfireuptown]

Could you add a test case for this? Thanks

i commit a new test case, please check it

[corgy-w]

Could you add a test case for this? Thanks

i commit a new test case, please check it

@SplitfireUptown Remember to retry the failure ci

[spitfireuptown]

Could you add a test case for this? Thanks

i commit a new test case, please check it

@SplitfireUptown Remember to retry the failure ci

please help me, i dont konw why doris test case report this error

and kafka test case log can not find any error log, but status is fail

[Hisoka-X]

Please retry failed ci.

[spitfireuptown]

Please retry failed ci.

need help, i dont konw why doris test case report this error

[spitfireuptown]

Please retry failed ci.

all ci successful

[Hisoka-X]

The test case can not reach the new code. I think you can use Mockito to set http response then parse it by the code you added. Please refer

seatunnel/seatunnel-engine/seatunnel-engine-core/src/test/java/org/apache/seatunnel/engine/core/classloader/ClassLoaderServiceTest.java

Line 117 in 99fa19d

Node mockNode = Mockito.mock(Node.class);

[spitfireuptown]

emmmm，new code add in org.apache.seatunnel.transform.nlpmodel.llm.remote.custom.CustomModel#chatWithModel，i need call org.apache.seatunnel.transform.nlpmodel.llm.remote.AbstractModel#inference in test code, if i want test it，i need a server to mock ollama data, because request http interface code and new code in one function，i try many time and dont know how can i run it in outside test code。can u help me please

[spitfireuptown]

nerver mind i got it!

[corgy-w]

Remind you to develop the habit of commenting in En

[spitfireuptown]

code is ok please check it