Kafka / rs_export_rtdb?? erreur ?

Hi Claes,
I have been trying for a while to set up Ssab_export_rtdb for kafka but to generate with rs_export_rtdb it tells me that the version is not compiled for ??? rs_export_rtdb
rs_export_rtdb not built for this release ???
 
I had version 6.1.3 then I installed 6.1.5?
Thank You   /SEB

 

Here, in ssabox version 6.1.5 /exe/ we compiled rs_export_gen and the output seems correct: "$ rs_export_gen
I Adding application. aix: 22
/usr/pwr61/load/select.json generated with 140 columns" and for rs_export_rtdb it's more complicated, we're stuck on the segmentation fault? ".1")}, 16) = 0
poll([{fd=4, events=POLLOUT}], 1, 0) = 1 ([{fd=4, revents=POLLOUT}])
sendto(4, "}n\1\0\0\1\0\0\0\0\0\0\"saal-schema-registr"..., 85, MSG_NOSIGNAL, NULL, 0) = 85
poll([{fd=4, events=POLLIN}], 1, 5000) = 1 ([{fd=4, revents=POLLIN}])
ioctl(4, FIONREAD, [160]) = 0
recvfrom(4, "}n\201\203\0\1\0\0\0\1\0\0\"saal-schema-registr"..., 1024, 0, {sa_family=AF_INET, sin_port=htons(53), sin_addr=inet_addr("192.168.1.1")}, [28 => 16]) = 160
close(4) = 0
--- SIGSEGV {si_signo=SIGSEGV, si_code=SEGV_MAPERR, si_addr=0x14} ---
+++ killed by SIGSEGV +++
Segmentation fault
" ?? We followed the Kafka documentation for 6.1.5. Could you help me? Thanks

Hi Seb,

I'm not familiar with the details of how to create a kafka database, but you have to configure a schema registry and the url for the registry should be inserted in the Ssab_ExportRtdbServer object. rs_export_rtdb will check that the schema is up to date and if not a new one is sent. I guess the segfault is when the port to the registry can't be opened.

My experience is that is not so easy to get everything to work with certificate and registry. One hint is to set exp_debug = 1 in rs_export_rtdb.cpp to get more output prints from rs_export_rtdb.

/Claes

Hi Claes,
So, I added rs_export_rtdb.cpp to enable debug mode:
exp_debug = 1;
then I recompiled and got this error:

rs_export_rtdb
freq 1 batches 1
Kafka topic: proview_data
Generating Avro schema...
Erreur de segmentation
Do you have any idea about Avro?
Thank You

Hello Claes,
Here are the error codes if that helps? Maybe it works elsewhere? I've reached our limits...
ioctl(4, FIONREAD, [160]) = 0
recvfrom(4, "\332z\201\203\0\1\0\0\0\1\0\0\"saal-schema-registry-confluent-api\4apps\rse-oxd-dc-ocp\4ssab\3com\4Home\0\0\1\0\1\0\0\6\0\1\0\0*0\0@\1a\froot-servers\3net\0\5nstld\fverisign-grs\3com\0x\263\257\211\0\0\7\10\0\0\3\204\0\t:\200\0\1Q\200", 1024, 0, {sa_family=AF_INET, sin_port=htons(53), sin_addr=inet_addr("192.168.1.1")}, [28 => 16]) = 160
close(4) = 0
--- SIGSEGV {si_signo=SIGSEGV, si_code=SEGV_MAPERR, si_addr=0x14} ---
+++ killed by SIGSEGV +++
Erreur de segmentation

Hi Seb,

To see all the output prints you have to make sure too the cpp files in ssabox/exe/rs_rtdb_rtdb/src are recompiled. You can for example use the command 'touch' to update the date on the files and then build again.

Avro is the format of the schema and if exp_debug is set the schema is written to $pwrp_log/avro_schema.json. In the next step the avro schema is sent to the schema registry and I still suspect that it's the connection to the schema registry that fails. You have to configure a schema registry in the kafka environment and insert the url to the registry in Ssab_ExportRtdbServer.SchemaRegistryURL.

/Claes