DataWorks operation error collection of SQL lines of code is too long to generate errors, how to solve the problem

Question 1: In Dataworks, the lines of code are too long (1700 lines) and the submission error is reported.

Dataworks: Long lines of code (1700 lines) commit error Has anyone encountered this?

Refer to the answer:

In DataWorks if there are too many lines of SQL code, it may cause the task to fail. When the code exceeds 12MB, the system will have a processing limit. It is recommended that you streamline the long code logic or split it into multiple tasks to solve the problem. You can refer to the documentation of DataWorks, a big data development governance platform.

More answers to this question can be found in the original article:

https://developer.aliyun.com/ask/630820

Question 2: DataWorks is configured on the page and used to read the folder named after yesterday's date, but what if there is no oss on individual days?

DataWorks on the page configuration, used to read yesterday's date-named folder, but individual days oss did not, and then reported that the path could not be found, I want to read more of a fixed name of the empty folder so that it will not report an error?

Reference answer:

I don't think so, only fuzzy match, can't specify fixed two paths https://help.aliyun.com/zh/dataworks/user-guide/check-node?spm=a2c4g.11186623.0.i2

The check node can be looked at, but it can only synchronize with the output of the oss file, if the file is not there, it will still report an error.

More answers to this question can be found in the original article:

https://developer.aliyun.com/ask/629694

Question 3: Creating clickhouse SQL in dataworks data development gives an error, where is this data source configured?

Creating clickhouse SQL in dataworks data development reports error, data source null does not exist,, where is this data source configured?

Reference answer:

You can refer to see

https://help.aliyun.com/zh/dataworks/user-guide/associate-data-sources-in-datastudio?spm=a2c4g.11186623.0.i2

More answers on this question can be viewed by clicking on the original article:

https://developer.aliyun.com/ask/629411

Question 4: Clicking Run Manually on the Hologres node in DataWorks has been unsuccessful with the following message: What should I do?

The Hologres node in DataWorks clicks to run manually and has been unsuccessful with the following message: FAILED: Build connection error! The connection attempt failed?

The connection attempt failed?

After passing the connectivity test for a holo data source exclusive scheduling resource group, the current task point Advanced Run, select the corresponding resource group, and “Run with parameters”.

More answers to this question can be found in the original article:

https://developer.aliyun.com/ask/629406

Question 5: After DataWorks is configured, the execution keeps reporting the following error, what is the reason?

What is the reason that DataWorks keeps reporting the following error after it is configured?

The configuration is like this

Refer to the answer:

If you purchased the exclusive resource group before 240101, please provide us with the locale and resource group name, and we will upgrade it.

Currently, this feature can only be used by exclusive scheduling resource groups.

More answers to this question can be found in the original article:

https://developer.aliyun.com/ask/629404

Privacy    |    Terms of use